# Compare inference platforms

Check service regions with each provider.

31 GPU cloud providers. Also on the [web page](https://gpuclouds.fyi/us/global/online/category/inference-platforms).

## GPU cloud providers

1. [Together AI](https://gpuclouds.fyi/us/global/online/together-ai.md), Inference platforms, Online: AI platform offering serverless and dedicated inference APIs for open models, fine-tuning, and self-serve GPU clusters (H100, H200, B200, B300, GB200/GB300)…
2. [Atlas Cloud](https://gpuclouds.fyi/us/global/online/atlas-cloud.md), Inference platforms, Online: Atlas Cloud offers a single OpenAI-compatible API for 400+ image, video, audio and language models, plus on-demand GPU instances with NVIDIA H100 SXM and H200…
3. [Baseten](https://gpuclouds.fyi/us/global/online/baseten.md), Inference platforms, Online: AI inference platform offering model APIs, dedicated model deployments and training on GPU instances from T4 to B200, billed by the minute, with options to…
4. [Cerebrium](https://gpuclouds.fyi/us/global/online/cerebrium.md), Serverless GPU, Online: Serverless AI infrastructure platform for deploying LLM, voice and image workloads on GPUs from T4 to B200, scaling with demand and charging for compute time…
5. [Crusoe](https://gpuclouds.fyi/us/global/online/crusoe.md), GPU neoclouds, Online: AI cloud offering NVIDIA and AMD GPU instances (GB300, B300, H200, H100, A100, L40S, MI300X) on spot, on-demand or reserved terms, plus managed Kubernetes,…
6. [DeepInfra](https://gpuclouds.fyi/us/global/online/deepinfra.md), Inference platforms, Online: Inference platform serving open and proprietary models via API priced per token or per unit, plus custom model deployments on dedicated A100, H100, H200, B200…
7. [Featherless](https://gpuclouds.fyi/us/global/online/featherless.md), Inference platforms, Online: Serverless inference platform for open-weight models with an OpenAI-compatible API, monthly chat subscriptions, metered developer plans and dedicated GPU…
8. [Fireworks AI](https://gpuclouds.fyi/us/global/online/fireworks-ai.md), Inference platforms, Online: Generative AI inference platform offering serverless per-token model APIs, fine-tuning and training, and on-demand GPU deployments on H100 to GB300 GPUs priced…
9. [FriendliAI](https://gpuclouds.fyi/us/global/online/friendliai.md), Inference platforms, Online: AI inference platform offering model APIs, on-demand dedicated GPU endpoints on A100 to B300 GPUs billed per second, and bring-your-own-GPU deployments, with…
10. [GMI Cloud](https://gpuclouds.fyi/us/global/online/gmi-cloud.md), GPU neoclouds, Online: GMI Cloud provides dedicated single-tenant NVIDIA GPUs (H100, H200, B200, GB200, GB300) in GMI-operated data centers, on-demand or reserved, priced per…
11. [Hugging Face Inference Endpoints](https://gpuclouds.fyi/us/global/online/hugging-face-inference-endpoints.md), Inference platforms, Online: Managed service from Hugging Face for deploying models on dedicated, autoscaling endpoints on AWS, GCP or Azure infrastructure, with GPU instances (T4, L4,…
12. [Modal](https://gpuclouds.fyi/us/global/online/modal.md), Serverless GPU, Online: Serverless AI infrastructure platform for running inference, training, batch jobs and sandboxes on GPUs and CPUs that spin up in seconds, billed per second for…
13. [Novita AI](https://gpuclouds.fyi/us/global/online/novita-ai.md), Inference platforms, Online: AI cloud offering model inference APIs for LLM, image, video and audio, plus GPU instances and serverless GPUs across 14 global regions, with on-demand and…
14. [Parasail](https://gpuclouds.fyi/us/global/online/parasail.md), Inference platforms, Online: AI inference platform offering per-token serverless endpoints for open models, self-service batch processing, and dedicated deployments on reserved NVIDIA GPUs…
15. [Phala Cloud (GPU TEE)](https://gpuclouds.fyi/us/global/online/phala-cloud-gpu-tee.md), GPU neoclouds, Online: Confidential AI cloud running containers, private LLM inference and GPU jobs inside hardware TEEs (Intel TDX, NVIDIA confidential computing) with attestation;…
16. [Segmind](https://gpuclouds.fyi/us/global/online/segmind.md), Inference platforms, Online: Generative AI platform offering serverless pay-as-you-go APIs for image, video and other media models, Pixelflow workflows, fine-tuning, and dedicated GPU…
17. [Anyscale](https://gpuclouds.fyi/us/global/online/anyscale.md), Inference platforms, Online: Managed Ray platform for distributed training, batch inference and model serving, offering Anyscale-hosted GPU compute (T4, L4, A10G, A100, H/B/GB families) or…
18. [fal](https://gpuclouds.fyi/us/global/online/fal.md), Inference platforms, Online: Generative media platform offering model APIs for image, video, audio and 3D generation billed per output, plus serverless compute for deploying custom apps on…
19. [Hyperbolic](https://gpuclouds.fyi/us/global/online/hyperbolic.md), GPU marketplaces, Online: AI compute platform offering on-demand and reserved NVIDIA H100, H200 and B200 GPUs sourced from a supplier network, managed Kubernetes with GPU worker nodes,…
20. [Inference.net](https://gpuclouds.fyi/us/global/online/inference-net.md), Inference platforms, Online: Inference infrastructure for open-source, custom and fine-tuned models, offering dedicated model deployments on B200 GPU instances priced per hour, plus…
21. [io.net](https://gpuclouds.fyi/us/global/online/io-net.md), Decentralized GPU, Online: Decentralized GPU cloud aggregating GPUs from many suppliers; offers on-demand GPU clusters (Ray, Kubernetes, containers, bare metal) plus io.intelligence…
22. [Prime Intellect](https://gpuclouds.fyi/us/global/online/prime-intellect.md), GPU marketplaces, Online: AI training, inference and compute platform offering on-demand access to 1-256 GPUs across clouds, reserved clusters quoted from 50+ providers, a spot resale…
23. [Super Protocol](https://gpuclouds.fyi/us/global/online/super-protocol.md), Inference platforms, Online: Confidential AI platform: Super Swarm runs AI workloads in CPU/GPU TEEs across clouds and data centers, and Confidential Router serves open models via an…
24. [Theta EdgeCloud](https://gpuclouds.fyi/us/global/online/theta-edgecloud.md), Decentralized GPU, Online: Hybrid cloud-edge platform from Theta offering on-demand GPU compute, hosted AI model inference, AI agents and video/rendering developer tools; contributors…
25. [Zenlayer (Distributed Inference / GPU compute)](https://gpuclouds.fyi/us/global/online/zenlayer-distributed-inference-gpu-compute.md), Inference platforms, Online: Zenlayer offers GPU compute for distributed AI inference with NVIDIA RTX 4090, H100 and H200, connected over its global private network spanning Asia, the…
26. [Groq](https://gpuclouds.fyi/us/global/online/groq.md), Inference platforms, Online: Inference cloud using Groq LPU accelerators, with dedicated bare-metal infrastructure, managed inference and enterprise controls, plus an OpenAI-compatible API.
27. [Cerebras](https://gpuclouds.fyi/us/global/online/cerebras.md), Inference platforms, Online: Inference cloud serving language models through public API endpoints and dedicated deployments on Cerebras wafer-scale hardware, with training and fine-tuning…
28. [Cloudflare Workers AI](https://gpuclouds.fyi/us/global/online/cloudflare-workers-ai.md), Inference platforms, Online: Serverless inference service running 50+ open-source models on GPUs across Cloudflare's global network, priced per Neuron ($0.011 per 1,000) with a free daily…
29. [Lilypad Network](https://gpuclouds.fyi/us/global/online/lilypad-network.md), Decentralized GPU, Online: Decentralized compute network and AI services platform where developers run AI inference jobs via an inference API or CLI on a global network of GPU resource…
30. [SambaNova](https://gpuclouds.fyi/us/global/online/sambanova.md), Inference platforms, Online: SambaCloud provides language model inference APIs priced per token on SambaNova RDU hardware; SambaStack supports deployments using the same inference…
31. [NVIDIA DGX Cloud Lepton](https://gpuclouds.fyi/us/global/online/nvidia-dgx-cloud-lepton.md), GPU marketplaces, Online: NVIDIA platform connecting developers to GPU compute across cloud partners and marketplaces, with a unified workflow for AI development, training and inference…

## Other categories in Online

- [GPU neoclouds](https://gpuclouds.fyi/us/global/online/category/gpu-neoclouds.md): 34 GPU cloud providers
- [Bare-metal GPU clusters](https://gpuclouds.fyi/us/global/online/category/bare-metal-gpu-clusters.md): 20 GPU cloud providers
- [GPU marketplaces](https://gpuclouds.fyi/us/global/online/category/gpu-marketplaces.md): 15 GPU cloud providers
- [Serverless GPU](https://gpuclouds.fyi/us/global/online/category/serverless-gpu.md): 15 GPU cloud providers
- [Decentralized GPU](https://gpuclouds.fyi/us/global/online/category/decentralized-gpu.md): 9 GPU cloud providers
- [Hyperscalers](https://gpuclouds.fyi/us/global/online/category/hyperscalers.md): 5 GPU cloud providers
- [Sovereign and regional GPU](https://gpuclouds.fyi/us/global/online/category/sovereign-regional-gpu.md): 1 GPU cloud provider
