Skip to content

Compare serverless GPU

Read the source for billing, capacity and GPU details.

Results

22 GPU cloud providers

  • GPU neocloudsOnline

    Jarvislabs

    GPU cloud offering on-demand and spot NVIDIA GPU instances (H200, H100, RTX Pro 6000, A100, A30, L4) billed per minute, instant H200 clusters, serverless and…

    Lowest on-demand H100 rate
    349 US cents/GPU-h
    Lowest on-demand A100 rate
    89 US cents/GPU-h
  • GPU neocloudsOnline

    Lyceum

    Offers GPU VMs, reserved clusters, serverless training and model inference in Europe, with per-second GPU billing and on-demand, spot and reserved capacity.

    Lowest on-demand H100 rate
    469 US cents/GPU-h
    Lowest on-demand A100 rate
    229 US cents/GPU-h
  • Sovereign and regional GPUOnline

    Seeweb

    Italian cloud provider offering on-demand and spot GPU servers for AI, machine learning and HPC, with hourly billing, Kubernetes integration and…

  • Inference platformsOnline

    Baseten

    AI inference platform offering model APIs, dedicated model deployments and training on GPU instances from T4 to B200, billed by the minute, with options to…

    Lowest on-demand H100 rate
    650 US cents/GPU-h
    Lowest on-demand A100 rate
    400 US cents/GPU-h
  • Serverless GPUOnline

    Beam

    Cloud platform offering serverless GPU endpoints billed by the millisecond, persistent VMs, sandboxes, on-demand bare-metal or VM GPU machines, reserved…

    Lowest on-demand H100 rate
    183 US cents/GPU-h
    Lowest on-demand A100 rate
    136 US cents/GPU-h
  • Serverless GPUOnline

    Cerebrium

    Serverless AI infrastructure platform for deploying LLM, voice and image workloads on GPUs from T4 to B200, scaling with demand and charging for compute time…

    Lowest on-demand H100 rate
    340 US cents/GPU-h
    Lowest on-demand A100 rate
    200 US cents/GPU-h
  • Inference platformsOnline

    DeepInfra

    Inference platform serving open and proprietary models via API priced per token or per unit, plus custom model deployments on dedicated A100, H100, H200, B200…

    Lowest on-demand H100 rate
    290 US cents/GPU-h
    Lowest on-demand A100 rate
    149 US cents/GPU-h
  • Inference platformsOnline

    Featherless

    Serverless inference platform for open-weight models with an OpenAI-compatible API, monthly chat subscriptions, metered developer plans and dedicated GPU…

  • Serverless GPUOnline

    Koyeb

    Serverless platform that deploys apps and inference endpoints in autoscaling VMs on bare-metal servers, with GPUs from L4 and RTX A6000 to A100, H100, H200 and…

    Lowest on-demand H100 rate
    250 US cents/GPU-h
    Lowest on-demand A100 rate
    160 US cents/GPU-h
  • GPU neocloudsOnline

    Lightning AI

    AI development platform (Lightning Studios) providing cloud GPU and CPU machines, from T4 and L4 to A100, H100, H200 and B200, billed by the second with…

    Lowest on-demand H100 rate
    545 US cents/GPU-h
    Lowest on-demand A100 rate
    155 US cents/GPU-h
  • Serverless GPUOnline

    Modal

    Serverless AI infrastructure platform for running inference, training, batch jobs and sandboxes on GPUs and CPUs that spin up in seconds, billed per second for…

    Lowest on-demand H100 rate
    395 US cents/GPU-h
    Lowest on-demand A100 rate
    210 US cents/GPU-h
  • Serverless GPUOnline

    Northflank

    Container deployment platform running workloads on Kubernetes in Northflank Cloud or the customer's own cloud, with on-demand NVIDIA GPUs (L4, A100, H100,…

    Lowest on-demand H100 rate
    274 US cents/GPU-h
    Lowest on-demand A100 rate
    142 US cents/GPU-h
  • Inference platformsOnline

    Novita AI

    AI cloud offering model inference APIs for LLM, image, video and audio, plus GPU instances and serverless GPUs across 14 global regions, with on-demand and…

  • GPU neocloudsOnline

    Runpod

    GPU cloud offering on-demand GPU pods across 30+ regions, serverless GPU endpoints for API inference, and multi-node GPU clusters, with Community Cloud and…

    Lowest on-demand H100 rate
    199 US cents/GPU-h
    Lowest on-demand A100 rate
    119 US cents/GPU-h
  • Inference platformsOnline

    Runware

    AI cloud offering model APIs, autoscaling serverless GPU workloads and reserved bare-metal clusters on its modular Sonic Pod infrastructure, with GPU usage…

    Lowest on-demand H100 rate
    395 US cents/GPU-h
  • Decentralized GPUOnline

    SaladCloud

    Distributed GPU cloud running containers on idle consumer RTX-class GPUs in homes and small businesses worldwide, with four priority tiers and per-second…

  • GPU neocloudsOnline

    Thunder Compute

    GPU cloud offering persistent on-demand GPU instances (RTX A6000, L40, A100 80GB, H100 SXM) billed per minute, and short-lived GPU sandboxes for agents billed…

    Lowest on-demand H100 rate
    320 US cents/GPU-h
    Lowest on-demand A100 rate
    109 US cents/GPU-h
  • GPU marketplacesOnline

    Vast.ai

    GPU marketplace where prices are set by supply and demand across 40+ data centers, offering on-demand, interruptible and reserved instances, plus serverless…

  • GPU neocloudsOnline

    Verda (formerly DataCrunch)

    European AI cloud (formerly DataCrunch) offering pay-as-you-go, spot and reserved NVIDIA GPU instances (GB300, B300, B200, H200, H100, A100, L40S), instant…

    Lowest on-demand H100 rate
    475 US cents/GPU-h
    Lowest on-demand A100 rate
    159 US cents/GPU-h
  • Inference platformsOnline

    Anyscale

    Managed Ray platform for distributed training, batch inference and model serving, offering Anyscale-hosted GPU compute (T4, L4, A10G, A100, H/B/GB families) or…

  • Inference platformsOnline

    fal

    Generative media platform offering model APIs for image, video, audio and 3D generation billed per output, plus serverless compute for deploying custom apps on…

    Lowest on-demand H100 rate
    450 US cents/GPU-h
  • Inference platformsOnline

    Cloudflare Workers AI

    Serverless inference service running 50+ open-source models on GPUs across Cloudflare's global network, priced per Neuron ($0.011 per 1,000) with a free daily…

Serverless GPU by city

Related categories

Questions

Which cities have the most serverless GPU?

The cities with the most serverless GPU are Online, Global (15 GPU cloud providers), Online, Global (2 GPU cloud providers), Online, Global (1 GPU cloud provider), Online, Global (1 GPU cloud provider), and Online, Global (1 GPU cloud provider).

Published by . How we check each GPU cloud provider.