Skip to content

Compare serverless GPU

Check service regions with each provider.

Results

15 GPU cloud providers

  • Inference platformsOnline

    Baseten

    AI inference platform offering model APIs, dedicated model deployments and training on GPU instances from T4 to B200, billed by the minute, with options to…

    Lowest on-demand H100 rate
    650 US cents/GPU-h
    Lowest on-demand A100 rate
    400 US cents/GPU-h
  • Serverless GPUOnline

    Beam

    Cloud platform offering serverless GPU endpoints billed by the millisecond, persistent VMs, sandboxes, on-demand bare-metal or VM GPU machines, reserved…

    Lowest on-demand H100 rate
    183 US cents/GPU-h
    Lowest on-demand A100 rate
    136 US cents/GPU-h
  • Serverless GPUOnline

    Cerebrium

    Serverless AI infrastructure platform for deploying LLM, voice and image workloads on GPUs from T4 to B200, scaling with demand and charging for compute time…

    Lowest on-demand H100 rate
    340 US cents/GPU-h
    Lowest on-demand A100 rate
    200 US cents/GPU-h
  • Inference platformsOnline

    DeepInfra

    Inference platform serving open and proprietary models via API priced per token or per unit, plus custom model deployments on dedicated A100, H100, H200, B200…

    Lowest on-demand H100 rate
    290 US cents/GPU-h
    Lowest on-demand A100 rate
    149 US cents/GPU-h
  • Inference platformsOnline

    Featherless

    Serverless inference platform for open-weight models with an OpenAI-compatible API, monthly chat subscriptions, metered developer plans and dedicated GPU…

  • GPU neocloudsOnline

    Lightning AI

    AI development platform (Lightning Studios) providing cloud GPU and CPU machines, from T4 and L4 to A100, H100, H200 and B200, billed by the second with…

    Lowest on-demand H100 rate
    545 US cents/GPU-h
    Lowest on-demand A100 rate
    155 US cents/GPU-h
  • Serverless GPUOnline

    Modal

    Serverless AI infrastructure platform for running inference, training, batch jobs and sandboxes on GPUs and CPUs that spin up in seconds, billed per second for…

    Lowest on-demand H100 rate
    395 US cents/GPU-h
    Lowest on-demand A100 rate
    210 US cents/GPU-h
  • Inference platformsOnline

    Novita AI

    AI cloud offering model inference APIs for LLM, image, video and audio, plus GPU instances and serverless GPUs across 14 global regions, with on-demand and…

  • GPU neocloudsOnline

    Runpod

    GPU cloud offering on-demand GPU pods across 30+ regions, serverless GPU endpoints for API inference, and multi-node GPU clusters, with Community Cloud and…

    Lowest on-demand H100 rate
    199 US cents/GPU-h
    Lowest on-demand A100 rate
    119 US cents/GPU-h
  • Decentralized GPUOnline

    SaladCloud

    Distributed GPU cloud running containers on idle consumer RTX-class GPUs in homes and small businesses worldwide, with four priority tiers and per-second…

  • GPU neocloudsOnline

    Thunder Compute

    GPU cloud offering persistent on-demand GPU instances (RTX A6000, L40, A100 80GB, H100 SXM) billed per minute, and short-lived GPU sandboxes for agents billed…

    Lowest on-demand H100 rate
    320 US cents/GPU-h
    Lowest on-demand A100 rate
    109 US cents/GPU-h
  • GPU marketplacesOnline

    Vast.ai

    GPU marketplace where prices are set by supply and demand across 40+ data centers, offering on-demand, interruptible and reserved instances, plus serverless…

  • Inference platformsOnline

    Anyscale

    Managed Ray platform for distributed training, batch inference and model serving, offering Anyscale-hosted GPU compute (T4, L4, A10G, A100, H/B/GB families) or…

  • Inference platformsOnline

    fal

    Generative media platform offering model APIs for image, video, audio and 3D generation billed per output, plus serverless compute for deploying custom apps on…

    Lowest on-demand H100 rate
    450 US cents/GPU-h
  • Inference platformsOnline

    Cloudflare Workers AI

    Serverless inference service running 50+ open-source models on GPUs across Cloudflare's global network, priced per Neuron ($0.011 per 1,000) with a free daily…

Other categories in Online

More GPU cloud providers

Questions

What other kinds of GPU cloud providers are in Online?

Other categories in Online: GPU neoclouds (34 GPU cloud providers), Inference platforms (31 GPU cloud providers), Bare-metal GPU clusters (20 GPU cloud providers), GPU marketplaces (15 GPU cloud providers), and Decentralized GPU (9 GPU cloud providers).

Published by . How we check each GPU cloud provider.