GPU infrastructure
Best GPU Cloud Providers: Current Price, Availability and LLM Fit
The cheapest hourly GPU is not automatically the best cloud for an LLM. VRAM, model size, storage persistence, startup time, region availability, billing behavior, networking, and how long the workload stays active all affect the real cost.
| Provider type | Infrastructure model | Good fit | Important caveat |
|---|---|---|---|
| Runpod | Dedicated GPU Pods, Serverless, and clusters | Flexible inference, experiments, persistent GPU workloads | Broad GPU selection and usage-based billing. Current availability and rates vary by GPU and region. |
| Lambda | GPU instances and larger GPU clusters | Dedicated AI workloads and higher-end NVIDIA infrastructure | Self-serve GPU instances plus cluster options. Hardware and availability vary by configuration. |
| Marketplace / spot-style GPU clouds | Independent hosts or variable-capacity GPU marketplaces | Cost-sensitive jobs where availability can be flexible | Potentially lower prices, but host quality, availability, networking, and persistence require closer scrutiny. |
| Hyperscale cloud GPU | GPU VMs and managed AI infrastructure | Existing cloud environments, enterprise controls, integrated networking | Strong ecosystem integration, but pricing and setup complexity can be higher. |
Are there cloud GPUs you can rent?
Yes. GPU cloud providers rent access to accelerators by the hour, second, reserved period, or managed-service plan depending on the platform. This lets you run AI workloads without purchasing and maintaining the physical GPU yourself.
What is the cheapest GPU for AI development?
The cheapest useful GPU depends on the model and workload. A lower-cost 16GB or 24GB accelerator may be enough for smaller or quantized models, while larger models can require 48GB, 80GB, or more VRAM. Choosing the cheapest card that cannot fit the workload usually costs more in failed runs, offloading, or engineering time.
Can you get a cloud GPU for free?
Some services occasionally provide trial credits or limited free compute, but sustained GPU inference normally costs money. Free access is better treated as an evaluation option than a dependable production strategy for an always-on agent or model server.
Can you rent an A100 or similar data-center GPU?
Yes. GPU clouds commonly offer data-center accelerators as rentable instances when capacity is available. The important comparison is not only the GPU name: VRAM, region, storage, network performance, availability, billing model, and total workload duration all affect the result.
GPU memory is the first filter
Current GPU clouds span cards with roughly 16–24GB of memory for smaller workloads through 48GB, 80GB, 96GB, 141GB, 180GB and larger accelerators. A model that does not fit comfortably in the available GPU memory may require a smaller quantization, CPU offload, multiple GPUs, or a different provider class.
Compare total workload cost, not just $/GPU-hour
- GPU hourly or per-second compute charge.
- Persistent storage while the GPU is stopped.
- Network or data-transfer charges where applicable.
- Cold-start or provisioning delay.
- Whether the exact GPU is reliably available in your region.
- Whether an always-on agent actually needs the GPU continuously.
- Operational work required to patch, restart, and recover the workload.
Current documented GPU cloud prices
These are dated first-party price observations, not hands-on performance rankings. GPU availability, regions, cloud tiers, taxes, storage, and other charges can change the effective cost.
| Provider | Product | GPU | VRAM | Published price | Source |
|---|---|---|---|---|---|
| Runpod | H200 Pod — Secure Cloud | NVIDIA H200 | 141 GB | $4.59/hour | Official pricing Data checked 2026-08-26 · Source: Runpod |
| Runpod | B200 Pod — Secure Cloud | NVIDIA B200 | 180 GB | $6.79/hour | Official pricing Data checked 2026-08-26 · Source: Runpod |
| Lambda | H100 PCIe Instance | NVIDIA H100 PCIe | 80 GB | $3.29/hour | Official pricing Data checked 2026-08-26 · Source: Lambda |
| Lambda | A6000 Instance | NVIDIA A6000 | 48 GB | $1.09/hour | Official pricing Data checked 2026-08-26 · Source: Lambda |
Why provider rankings will change
GPU pricing and availability change quickly. Agent Infra Guide will date provider observations and separate observed prices from durable technical characteristics instead of treating one price snapshot as permanent.