Inference platformsOnline
Runware
AI cloud offering model APIs, autoscaling serverless GPU workloads and reserved bare-metal clusters on its modular Sonic Pod infrastructure, with GPU usage…
- Lowest on-demand H100 rate
- 395 US cents/GPU-h
Compare inference platforms
Read the source for billing, capacity and GPU details.
Results
53 GPU cloud providers
Inference platformsOnline
Segmind
Generative AI platform offering serverless pay-as-you-go APIs for image, video and other media models, Pixelflow workflows, fine-tuning, and dedicated GPU…
- Lowest on-demand H100 rate
- 900 US cents/GPU-h
- Lowest on-demand A100 rate
- 432 US cents/GPU-h
GPU marketplacesOnline
Spheron
GPU cloud marketplace aggregating capacity from multiple data center providers into one dashboard, offering on-demand, spot and reserved GPU instances plus…
- Lowest on-demand H100 rate
- 420 US cents/GPU-h
- Lowest on-demand A100 rate
- 148 US cents/GPU-h
Decentralized GPUOnline
Akash Network
Decentralized compute marketplace where independent providers bid to host containerized workloads on GPUs and CPUs; also offers AkashML, OpenAI-compatible…
Inference platformsOnline
Anyscale
Managed Ray platform for distributed training, batch inference and model serving, offering Anyscale-hosted GPU compute (T4, L4, A10G, A100, H/B/GB families) or…
Inference platformsOnline
fal
Generative media platform offering model APIs for image, video, audio and 3D generation billed per output, plus serverless compute for deploying custom apps on…
- Lowest on-demand H100 rate
- 450 US cents/GPU-h
GPU neocloudsOnline
Gcore
Cloud offering NVIDIA GPU virtual machines and bare-metal servers for AI training, inference and HPC, with multi-GPU clusters, InfiniBand and Kubernetes…
GPU marketplacesOnline
Hyperbolic
AI compute platform offering on-demand and reserved NVIDIA H100, H200 and B200 GPUs sourced from a supplier network, managed Kubernetes with GPU worker nodes,…
- Lowest on-demand H100 rate
- 319 US cents/GPU-h
Inference platformsOnline
Inference.net
Inference infrastructure for open-source, custom and fine-tuned models, offering dedicated model deployments on B200 GPU instances priced per hour, plus…
Decentralized GPUOnline
io.net
Decentralized GPU cloud aggregating GPUs from many suppliers; offers on-demand GPU clusters (Ray, Kubernetes, containers, bare metal) plus io.intelligence…
- Lowest on-demand H100 rate
- 219 US cents/GPU-h
Decentralized GPUOnline
OpenGPU Network
Decentralized blockchain-based GPU network connecting providers and clients for AI inference, training and rendering; offers Relay OpenAI-compatible model API,…
GPU marketplacesOnline
Prime Intellect
AI training, inference and compute platform offering on-demand access to 1-256 GPUs across clouds, reserved clusters quoted from 50+ providers, a spot resale…
Inference platformsOnline
Super Protocol
Confidential AI platform: Super Swarm runs AI workloads in CPU/GPU TEEs across clouds and data centers, and Confidential Router serves open models via an…
Decentralized GPUOnline
Theta EdgeCloud
Hybrid cloud-edge platform from Theta offering on-demand GPU compute, hosted AI model inference, AI agents and video/rendering developer tools; contributors…
- Lowest on-demand H100 rate
- 229 US cents/GPU-h
- Lowest on-demand A100 rate
- 199 US cents/GPU-h
Inference platformsOnline
Zenlayer (Distributed Inference / GPU compute)
Zenlayer offers GPU compute for distributed AI inference with NVIDIA RTX 4090, H100 and H200, connected over its global private network spanning Asia, the…
Inference platformsOnline
Groq
Inference cloud using Groq LPU accelerators, with dedicated bare-metal infrastructure, managed inference and enterprise controls, plus an OpenAI-compatible API.
Sovereign and regional GPUOnline
Macquarie Cloud Services (Launch AI)
Australian managed cloud provider offering Launch AI, a sovereign model-as-a-service platform on Red Hat OpenShift with shared or dedicated capacity, priced at…
Inference platformsOnline
NetMind AI
AI platform offering a unified API to 100+ models plus GPU compute (H100, A100, RTX 4090) on-demand or reserved, GPU clusters for training, and dedicated…
GPU neocloudsOnline
Nscale
AI cloud offering bare-metal and on-demand NVIDIA GPU compute, managed Kubernetes and Slurm, and inference endpoints, run from its own and partner data centers…
Inference platformsOnline
Cerebras
Inference cloud serving language models through public API endpoints and dedicated deployments on Cerebras wafer-scale hardware, with training and fine-tuning…
Inference platformsOnline
Cloudflare Workers AI
Serverless inference service running 50+ open-source models on GPUs across Cloudflare's global network, priced per Neuron ($0.011 per 1,000) with a free daily…
Decentralized GPUOnline
Lilypad Network
Decentralized compute network and AI services platform where developers run AI inference jobs via an inference API or CLI on a global network of GPU resource…
Decentralized GPUOnline
Livepeer
Open, decentralized inference network for AI video workloads; independent GPU providers connect GPUs and set prices, and Livepeer Agent routes image, video,…
Inference platformsOnline
Magalu Cloud AI Hub
Provides hosted AI model inference through an OpenAI-compatible API, including language models, embeddings, rerankers and speech recognition, billed by token…
Inference platforms by city
Related categories
Questions
Which cities have the most inference platforms?
The cities with the most inference platforms are Online, Global (31 GPU cloud providers), Online, Global (3 GPU cloud providers), Online, Global (3 GPU cloud providers), Online, Global (3 GPU cloud providers), and Online, Global (2 GPU cloud providers).
Published by GPUClouds. How we check each GPU cloud provider.