# Compare inference platforms Read the source for billing, capacity and GPU details. 53 GPU cloud providers. Also on the [web page](https://gpuclouds.fyi/category/inference-platforms). ## GPU cloud providers 1. [Jarvislabs](https://gpuclouds.fyi/in/global/online/jarvislabs.md), GPU neoclouds, Online: GPU cloud offering on-demand and spot NVIDIA GPU instances (H200, H100, RTX Pro 6000, A100, A30, L4) billed per minute, instant H200 clusters, serverless and… 2. [Lyceum](https://gpuclouds.fyi/de/global/online/lyceum.md), GPU neoclouds, Online: Offers GPU VMs, reserved clusters, serverless training and model inference in Europe, with per-second GPU billing and on-demand, spot and reserved capacity. 3. [NeevCloud](https://gpuclouds.fyi/in/global/online/neevcloud.md), GPU neoclouds, Online: Indian AI cloud offering on-demand and reserved NVIDIA H100, A100, L40S and RTX PRO 6000 GPUs as Kubernetes-managed containers or VMs in India datacenters,… 4. [Together AI](https://gpuclouds.fyi/us/global/online/together-ai.md), Inference platforms, Online: AI platform offering serverless and dedicated inference APIs for open models, fine-tuning, and self-serve GPU clusters (H100, H200, B200, B300, GB200/GB300)… 5. [Atlas Cloud](https://gpuclouds.fyi/us/global/online/atlas-cloud.md), Inference platforms, Online: Atlas Cloud offers a single OpenAI-compatible API for 400+ image, video, audio and language models, plus on-demand GPU instances with NVIDIA H100 SXM and H200… 6. [Baseten](https://gpuclouds.fyi/us/global/online/baseten.md), Inference platforms, Online: AI inference platform offering model APIs, dedicated model deployments and training on GPU instances from T4 to B200, billed by the minute, with options to… 7. [Cerebrium](https://gpuclouds.fyi/us/global/online/cerebrium.md), Serverless GPU, Online: Serverless AI infrastructure platform for deploying LLM, voice and image workloads on GPUs from T4 to B200, scaling with demand and charging for compute time… 8. [Crusoe](https://gpuclouds.fyi/us/global/online/crusoe.md), GPU neoclouds, Online: AI cloud offering NVIDIA and AMD GPU instances (GB300, B300, H200, H100, A100, L40S, MI300X) on spot, on-demand or reserved terms, plus managed Kubernetes,… 9. [Cyfuture AI](https://gpuclouds.fyi/in/global/online/cyfuture-ai.md), GPU neoclouds, Online: Noida-based AI infrastructure provider renting NVIDIA B300, H100, A100, L40S, RTX PRO 6000 and V100 GPUs hourly or reserved, with GPU clusters, managed… 10. [DeepInfra](https://gpuclouds.fyi/us/global/online/deepinfra.md), Inference platforms, Online: Inference platform serving open and proprietary models via API priced per token or per unit, plus custom model deployments on dedicated A100, H100, H200, B200… 11. [Featherless](https://gpuclouds.fyi/us/global/online/featherless.md), Inference platforms, Online: Serverless inference platform for open-weight models with an OpenAI-compatible API, monthly chat subscriptions, metered developer plans and dedicated GPU… 12. [Fireworks AI](https://gpuclouds.fyi/us/global/online/fireworks-ai.md), Inference platforms, Online: Generative AI inference platform offering serverless per-token model APIs, fine-tuning and training, and on-demand GPU deployments on H100 to GB300 GPUs priced… 13. [FriendliAI](https://gpuclouds.fyi/us/global/online/friendliai.md), Inference platforms, Online: AI inference platform offering model APIs, on-demand dedicated GPU endpoints on A100 to B300 GPUs billed per second, and bring-your-own-GPU deployments, with… 14. [Glows.ai](https://gpuclouds.fyi/tw/global/online/glows-ai.md), GPU neoclouds, Online: Globally distributed GPU cloud for AI training and inference offering on-demand GPU instances, bare-metal and virtualized clusters, inference endpoints and… 15. [GMI Cloud](https://gpuclouds.fyi/us/global/online/gmi-cloud.md), GPU neoclouds, Online: GMI Cloud provides dedicated single-tenant NVIDIA GPUs (H100, H200, B200, GB200, GB300) in GMI-operated data centers, on-demand or reserved, priced per… 16. [HPC-AI.COM (HPC-AI Tech)](https://gpuclouds.fyi/sg/global/online/hpc-ai-com-hpc-ai-tech.md), GPU neoclouds, Online: Singapore-based GPU cloud offering on-demand 8-GPU full-machine rentals of NVIDIA B200, H200, H100 and RTX 4090/5090, billed per minute, plus reserved… 17. [Hugging Face Inference Endpoints](https://gpuclouds.fyi/us/global/online/hugging-face-inference-endpoints.md), Inference platforms, Online: Managed service from Hugging Face for deploying models on dedicated, autoscaling endpoints on AWS, GCP or Azure infrastructure, with GPU instances (T4, L4,… 18. [Koyeb](https://gpuclouds.fyi/fr/global/online/koyeb.md), Serverless GPU, Online: Serverless platform that deploys apps and inference endpoints in autoscaling VMs on bare-metal servers, with GPUs from L4 and RTX A6000 to A100, H100, H200 and… 19. [Modal](https://gpuclouds.fyi/us/global/online/modal.md), Serverless GPU, Online: Serverless AI infrastructure platform for running inference, training, batch jobs and sandboxes on GPUs and CPUs that spin up in seconds, billed per second for… 20. [Nebul](https://gpuclouds.fyi/nl/global/online/nebul.md), Sovereign and regional GPU, Online: European private AI cloud offering dedicated NVIDIA GPU infrastructure, clusters, Kubernetes and serverless or dedicated model inference for training and… 21. [Novita AI](https://gpuclouds.fyi/us/global/online/novita-ai.md), Inference platforms, Online: AI cloud offering model inference APIs for LLM, image, video and audio, plus GPU instances and serverless GPUs across 14 global regions, with on-demand and… 22. [OVHcloud](https://gpuclouds.fyi/fr/global/online/ovhcloud.md), Sovereign and regional GPU, Online: Cloud provider offering NVIDIA GPU instances, managed Kubernetes, AI notebooks, model training, application deployment and serverless model APIs with… 23. [Parasail](https://gpuclouds.fyi/us/global/online/parasail.md), Inference platforms, Online: AI inference platform offering per-token serverless endpoints for open models, self-service batch processing, and dedicated deployments on reserved NVIDIA GPUs… 24. [Phala Cloud (GPU TEE)](https://gpuclouds.fyi/us/global/online/phala-cloud-gpu-tee.md), GPU neoclouds, Online: Confidential AI cloud running containers, private LLM inference and GPU jobs inside hardware TEEs (Intel TDX, NVIDIA confidential computing) with attestation;… 25. [Runware](https://gpuclouds.fyi/gb/global/online/runware.md), Inference platforms, Online: AI cloud offering model APIs, autoscaling serverless GPU workloads and reserved bare-metal clusters on its modular Sonic Pod infrastructure, with GPU usage… 26. [Segmind](https://gpuclouds.fyi/us/global/online/segmind.md), Inference platforms, Online: Generative AI platform offering serverless pay-as-you-go APIs for image, video and other media models, Pixelflow workflows, fine-tuning, and dedicated GPU… 27. [Spheron](https://gpuclouds.fyi/sg/global/online/spheron.md), GPU marketplaces, Online: GPU cloud marketplace aggregating capacity from multiple data center providers into one dashboard, offering on-demand, spot and reserved GPU instances plus… 28. [Akash Network](https://gpuclouds.fyi/ky/global/online/akash-network.md), Decentralized GPU, Online: Decentralized compute marketplace where independent providers bid to host containerized workloads on GPUs and CPUs; also offers AkashML, OpenAI-compatible… 29. [Anyscale](https://gpuclouds.fyi/us/global/online/anyscale.md), Inference platforms, Online: Managed Ray platform for distributed training, batch inference and model serving, offering Anyscale-hosted GPU compute (T4, L4, A10G, A100, H/B/GB families) or… 30. [fal](https://gpuclouds.fyi/us/global/online/fal.md), Inference platforms, Online: Generative media platform offering model APIs for image, video, audio and 3D generation billed per output, plus serverless compute for deploying custom apps on… 31. [Gcore](https://gpuclouds.fyi/lu/global/online/gcore.md), GPU neoclouds, Online: Cloud offering NVIDIA GPU virtual machines and bare-metal servers for AI training, inference and HPC, with multi-GPU clusters, InfiniBand and Kubernetes… 32. [Hyperbolic](https://gpuclouds.fyi/us/global/online/hyperbolic.md), GPU marketplaces, Online: AI compute platform offering on-demand and reserved NVIDIA H100, H200 and B200 GPUs sourced from a supplier network, managed Kubernetes with GPU worker nodes,… 33. [Inference.net](https://gpuclouds.fyi/us/global/online/inference-net.md), Inference platforms, Online: Inference infrastructure for open-source, custom and fine-tuned models, offering dedicated model deployments on B200 GPU instances priced per hour, plus… 34. [io.net](https://gpuclouds.fyi/us/global/online/io-net.md), Decentralized GPU, Online: Decentralized GPU cloud aggregating GPUs from many suppliers; offers on-demand GPU clusters (Ray, Kubernetes, containers, bare metal) plus io.intelligence… 35. [OpenGPU Network](https://gpuclouds.fyi/vg/global/online/opengpu-network.md), Decentralized GPU, Online: Decentralized blockchain-based GPU network connecting providers and clients for AI inference, training and rendering; offers Relay OpenAI-compatible model API,… 36. [Prime Intellect](https://gpuclouds.fyi/us/global/online/prime-intellect.md), GPU marketplaces, Online: AI training, inference and compute platform offering on-demand access to 1-256 GPUs across clouds, reserved clusters quoted from 50+ providers, a spot resale… 37. [Super Protocol](https://gpuclouds.fyi/us/global/online/super-protocol.md), Inference platforms, Online: Confidential AI platform: Super Swarm runs AI workloads in CPU/GPU TEEs across clouds and data centers, and Confidential Router serves open models via an… 38. [Theta EdgeCloud](https://gpuclouds.fyi/us/global/online/theta-edgecloud.md), Decentralized GPU, Online: Hybrid cloud-edge platform from Theta offering on-demand GPU compute, hosted AI model inference, AI agents and video/rendering developer tools; contributors… 39. [Zenlayer (Distributed Inference / GPU compute)](https://gpuclouds.fyi/us/global/online/zenlayer-distributed-inference-gpu-compute.md), Inference platforms, Online: Zenlayer offers GPU compute for distributed AI inference with NVIDIA RTX 4090, H100 and H200, connected over its global private network spanning Asia, the… 40. [Groq](https://gpuclouds.fyi/us/global/online/groq.md), Inference platforms, Online: Inference cloud using Groq LPU accelerators, with dedicated bare-metal infrastructure, managed inference and enterprise controls, plus an OpenAI-compatible API. 41. [Macquarie Cloud Services (Launch AI)](https://gpuclouds.fyi/au/global/online/macquarie-cloud-services-launch-ai.md), Sovereign and regional GPU, Online: Australian managed cloud provider offering Launch AI, a sovereign model-as-a-service platform on Red Hat OpenShift with shared or dedicated capacity, priced at… 42. [NetMind AI](https://gpuclouds.fyi/gb/global/online/netmind-ai.md), Inference platforms, Online: AI platform offering a unified API to 100+ models plus GPU compute (H100, A100, RTX 4090) on-demand or reserved, GPU clusters for training, and dedicated… 43. [Nscale](https://gpuclouds.fyi/gb/global/online/nscale.md), GPU neoclouds, Online: AI cloud offering bare-metal and on-demand NVIDIA GPU compute, managed Kubernetes and Slurm, and inference endpoints, run from its own and partner data centers… 44. [Cerebras](https://gpuclouds.fyi/us/global/online/cerebras.md), Inference platforms, Online: Inference cloud serving language models through public API endpoints and dedicated deployments on Cerebras wafer-scale hardware, with training and fine-tuning… 45. [Cloudflare Workers AI](https://gpuclouds.fyi/us/global/online/cloudflare-workers-ai.md), Inference platforms, Online: Serverless inference service running 50+ open-source models on GPUs across Cloudflare's global network, priced per Neuron ($0.011 per 1,000) with a free daily… 46. [Lilypad Network](https://gpuclouds.fyi/us/global/online/lilypad-network.md), Decentralized GPU, Online: Decentralized compute network and AI services platform where developers run AI inference jobs via an inference API or CLI on a global network of GPU resource… 47. [Livepeer](https://gpuclouds.fyi/ky/global/online/livepeer.md), Decentralized GPU, Online: Open, decentralized inference network for AI video workloads; independent GPU providers connect GPUs and set prices, and Livepeer Agent routes image, video,… 48. [Magalu Cloud AI Hub](https://gpuclouds.fyi/br/global/online/magalu-cloud-ai-hub.md), Inference platforms, Online: Provides hosted AI model inference through an OpenAI-compatible API, including language models, embeddings, rerankers and speech recognition, billed by token… 49. [ResetData](https://gpuclouds.fyi/au/global/online/resetdata.md), Sovereign and regional GPU, Online: Australian sovereign AI provider and NVIDIA Cloud Partner offering GPU-as-a-Service (bare metal, Kubernetes/OpenShift, clustered GPU job scheduling) and a… 50. [SambaNova](https://gpuclouds.fyi/us/global/online/sambanova.md), Inference platforms, Online: SambaCloud provides language model inference APIs priced per token on SambaNova RDU hardware; SambaStack supports deployments using the same inference… This copy lists 50 of 53. The [web page](https://gpuclouds.fyi/category/inference-platforms) has the rest. ## Inference platforms by city - [Online, Global](https://gpuclouds.fyi/us/global/online/category/inference-platforms.md): 31 GPU cloud providers - [Online, Global](https://gpuclouds.fyi/gb/global/online/category/inference-platforms.md): 3 GPU cloud providers - [Online, Global](https://gpuclouds.fyi/in/global/online/category/inference-platforms.md): 3 GPU cloud providers - [Online, Global](https://gpuclouds.fyi/sg/global/online/category/inference-platforms.md): 3 GPU cloud providers - [Online, Global](https://gpuclouds.fyi/au/global/online/category/inference-platforms.md): 2 GPU cloud providers - [Online, Global](https://gpuclouds.fyi/fr/global/online/category/inference-platforms.md): 2 GPU cloud providers - [Online, Global](https://gpuclouds.fyi/ky/global/online/category/inference-platforms.md): 2 GPU cloud providers - [Online, Global](https://gpuclouds.fyi/br/global/online/category/inference-platforms.md): 1 GPU cloud provider - [Online, Global](https://gpuclouds.fyi/ca/global/online/category/inference-platforms.md): 1 GPU cloud provider - [Online, Global](https://gpuclouds.fyi/de/global/online/category/inference-platforms.md): 1 GPU cloud provider - [Online, Global](https://gpuclouds.fyi/lu/global/online/category/inference-platforms.md): 1 GPU cloud provider - [Online, Global](https://gpuclouds.fyi/nl/global/online/category/inference-platforms.md): 1 GPU cloud provider - [Online, Global](https://gpuclouds.fyi/tw/global/online/category/inference-platforms.md): 1 GPU cloud provider - [Online, Global](https://gpuclouds.fyi/vg/global/online/category/inference-platforms.md): 1 GPU cloud provider ## Related categories - [GPU neoclouds](https://gpuclouds.fyi/category/gpu-neoclouds.md): 84 GPU cloud providers - [Sovereign and regional GPU](https://gpuclouds.fyi/category/sovereign-regional-gpu.md): 51 GPU cloud providers - [Bare-metal GPU clusters](https://gpuclouds.fyi/category/bare-metal-gpu-clusters.md): 47 GPU cloud providers - [GPU marketplaces](https://gpuclouds.fyi/category/gpu-marketplaces.md): 23 GPU cloud providers - [Serverless GPU](https://gpuclouds.fyi/category/serverless-gpu.md): 22 GPU cloud providers - [Decentralized GPU](https://gpuclouds.fyi/category/decentralized-gpu.md): 21 GPU cloud providers - [Hyperscalers](https://gpuclouds.fyi/category/hyperscalers.md): 14 GPU cloud providers