Skip to content

Compare inference platforms

Read the source for billing, capacity and GPU details.

Results

53 GPU cloud providers

  • GPU neocloudsOnline

    Jarvislabs

    GPU cloud offering on-demand and spot NVIDIA GPU instances (H200, H100, RTX Pro 6000, A100, A30, L4) billed per minute, instant H200 clusters, serverless and…

    Lowest on-demand H100 rate
    349 US cents/GPU-h
    Lowest on-demand A100 rate
    89 US cents/GPU-h
  • GPU neocloudsOnline

    Lyceum

    Offers GPU VMs, reserved clusters, serverless training and model inference in Europe, with per-second GPU billing and on-demand, spot and reserved capacity.

    Lowest on-demand H100 rate
    469 US cents/GPU-h
    Lowest on-demand A100 rate
    229 US cents/GPU-h
  • GPU neocloudsOnline

    NeevCloud

    Indian AI cloud offering on-demand and reserved NVIDIA H100, A100, L40S and RTX PRO 6000 GPUs as Kubernetes-managed containers or VMs in India datacenters,…

  • Inference platformsOnline

    Together AI

    AI platform offering serverless and dedicated inference APIs for open models, fine-tuning, and self-serve GPU clusters (H100, H200, B200, B300, GB200/GB300)…

    Lowest on-demand H100 rate
    399 US cents/GPU-h
  • Inference platformsOnline

    Atlas Cloud

    Atlas Cloud offers a single OpenAI-compatible API for 400+ image, video, audio and language models, plus on-demand GPU instances with NVIDIA H100 SXM and H200…

    Lowest on-demand H100 rate
    295 US cents/GPU-h
  • Inference platformsOnline

    Baseten

    AI inference platform offering model APIs, dedicated model deployments and training on GPU instances from T4 to B200, billed by the minute, with options to…

    Lowest on-demand H100 rate
    650 US cents/GPU-h
    Lowest on-demand A100 rate
    400 US cents/GPU-h
  • Serverless GPUOnline

    Cerebrium

    Serverless AI infrastructure platform for deploying LLM, voice and image workloads on GPUs from T4 to B200, scaling with demand and charging for compute time…

    Lowest on-demand H100 rate
    340 US cents/GPU-h
    Lowest on-demand A100 rate
    200 US cents/GPU-h
  • GPU neocloudsOnline

    Crusoe

    AI cloud offering NVIDIA and AMD GPU instances (GB300, B300, H200, H100, A100, L40S, MI300X) on spot, on-demand or reserved terms, plus managed Kubernetes,…

    Lowest on-demand H100 rate
    390 US cents/GPU-h
    Lowest on-demand A100 rate
    200 US cents/GPU-h
  • GPU neocloudsOnline

    Cyfuture AI

    Noida-based AI infrastructure provider renting NVIDIA B300, H100, A100, L40S, RTX PRO 6000 and V100 GPUs hourly or reserved, with GPU clusters, managed…

    Lowest on-demand H100 rate
    299 US cents/GPU-h
  • Inference platformsOnline

    DeepInfra

    Inference platform serving open and proprietary models via API priced per token or per unit, plus custom model deployments on dedicated A100, H100, H200, B200…

    Lowest on-demand H100 rate
    290 US cents/GPU-h
    Lowest on-demand A100 rate
    149 US cents/GPU-h
  • Inference platformsOnline

    Featherless

    Serverless inference platform for open-weight models with an OpenAI-compatible API, monthly chat subscriptions, metered developer plans and dedicated GPU…

  • Inference platformsOnline

    Fireworks AI

    Generative AI inference platform offering serverless per-token model APIs, fine-tuning and training, and on-demand GPU deployments on H100 to GB300 GPUs priced…

    Lowest on-demand H100 rate
    800 US cents/GPU-h
  • Inference platformsOnline

    FriendliAI

    AI inference platform offering model APIs, on-demand dedicated GPU endpoints on A100 to B300 GPUs billed per second, and bring-your-own-GPU deployments, with…

    Lowest on-demand H100 rate
    500 US cents/GPU-h
    Lowest on-demand A100 rate
    400 US cents/GPU-h
  • GPU neocloudsOnline

    Glows.ai

    Globally distributed GPU cloud for AI training and inference offering on-demand GPU instances, bare-metal and virtualized clusters, inference endpoints and…

    Lowest on-demand H100 rate
    296 US cents/GPU-h
    Lowest on-demand A100 rate
    120 US cents/GPU-h
  • GPU neocloudsOnline

    GMI Cloud

    GMI Cloud provides dedicated single-tenant NVIDIA GPUs (H100, H200, B200, GB200, GB300) in GMI-operated data centers, on-demand or reserved, priced per…

    Lowest on-demand H100 rate
    260 US cents/GPU-h
  • GPU neocloudsOnline

    HPC-AI.COM (HPC-AI Tech)

    Singapore-based GPU cloud offering on-demand 8-GPU full-machine rentals of NVIDIA B200, H200, H100 and RTX 4090/5090, billed per minute, plus reserved…

    Lowest on-demand H100 rate
    242 US cents/GPU-h
  • Inference platformsOnline

    Hugging Face Inference Endpoints

    Managed service from Hugging Face for deploying models on dedicated, autoscaling endpoints on AWS, GCP or Azure infrastructure, with GPU instances (T4, L4,…

    Lowest on-demand H100 rate
    1,000 US cents/GPU-h
    Lowest on-demand A100 rate
    250 US cents/GPU-h
  • Serverless GPUOnline

    Koyeb

    Serverless platform that deploys apps and inference endpoints in autoscaling VMs on bare-metal servers, with GPUs from L4 and RTX A6000 to A100, H100, H200 and…

    Lowest on-demand H100 rate
    250 US cents/GPU-h
    Lowest on-demand A100 rate
    160 US cents/GPU-h
  • Serverless GPUOnline

    Modal

    Serverless AI infrastructure platform for running inference, training, batch jobs and sandboxes on GPUs and CPUs that spin up in seconds, billed per second for…

    Lowest on-demand H100 rate
    395 US cents/GPU-h
    Lowest on-demand A100 rate
    210 US cents/GPU-h
  • Sovereign and regional GPUOnline

    Nebul

    European private AI cloud offering dedicated NVIDIA GPU infrastructure, clusters, Kubernetes and serverless or dedicated model inference for training and…

  • Inference platformsOnline

    Novita AI

    AI cloud offering model inference APIs for LLM, image, video and audio, plus GPU instances and serverless GPUs across 14 global regions, with on-demand and…

  • Sovereign and regional GPUOnline

    OVHcloud

    Cloud provider offering NVIDIA GPU instances, managed Kubernetes, AI notebooks, model training, application deployment and serverless model APIs with…

    Lowest on-demand H100 rate
    299 US cents/GPU-h
    Lowest on-demand A100 rate
    307 US cents/GPU-h
  • Inference platformsOnline

    Parasail

    AI inference platform offering per-token serverless endpoints for open models, self-service batch processing, and dedicated deployments on reserved NVIDIA GPUs…

  • GPU neocloudsOnline

    Phala Cloud (GPU TEE)

    Confidential AI cloud running containers, private LLM inference and GPU jobs inside hardware TEEs (Intel TDX, NVIDIA confidential computing) with attestation;…

    Lowest on-demand H100 rate
    308 US cents/GPU-h

Inference platforms by city

Related categories

Questions

Which cities have the most inference platforms?

The cities with the most inference platforms are Online, Global (31 GPU cloud providers), Online, Global (3 GPU cloud providers), Online, Global (3 GPU cloud providers), Online, Global (3 GPU cloud providers), and Online, Global (2 GPU cloud providers).

Published by . How we check each GPU cloud provider.