How much does the NVIDIA A100 40GB cost per hour to rent?

On Runcrate the NVIDIA A100 40GB starts at $1.99/hr per GPU on demand today, up to $4.15/hr depending on region and configuration. Billed by the second on most GPUs (a few bill by the minute), with no commitment. Reserved capacity is quoted on request.

Can I rent the NVIDIA A100 40GB on demand right now?

Yes. The NVIDIA A100 40GB is on demand in 5 regions today, billed by the second on most GPUs (a few bill by the minute) with no contract.

A100 40GB or A100 80GB?

Same Ampere compute, half the memory. Pick 40GB when the weights plus KV cache or optimizer state fit in 40 GB (13B inference, QLoRA up to about 30B); pick 80GB above that.

NVIDIA · Ampere · 2020

NVIDIA A100 40GB. 40 GB HBM2, 312 TFLOPS FP16 tensor.

Name: NVIDIA A100 40GB GPU Cloud Instance
Brand: NVIDIA
Price: 1.99 USD
Availability: InStock

Ampere with 40 GB of HBM2: A100 compute for models that fit in 40 GB, for less per hour.

Launch A100 40GB Get a reserved quote

A100 40GB on demand

from/hr per GPU

Availability: Available now · 5 regions
By region and size: $1.99 to $4.15/hr
Billing: By the second on most GPUs, a few by the minute
8+ GPUs or a month: Launch any size yourself, and prepay 1 to 12 months when you launch an instance. Custom quotes on request.

The machine

40 GB of HBM2. At 1.6 TB/s.

Memory: 40 GB; HBM2
Bandwidth: 1.6 TB/s; Memory to compute
FP16 tensor: 312; TFLOPS
Per node: 8 GPUs; up to 400 W each

Price across clouds

NVIDIA A100 40GB, cloud by cloud. Sorted by price.

On-demand rates per GPU-hour from each cloud's public price page on 22 Oct 2026: RunPod's Secure Cloud, and Lambda's lowest per-GPU rate across its cluster sizes. Runcrate's row is today's live starting rate.

Runcrate$1.99/hr

Lambda$1.99/hr

Workloads

What teams run on the A100 40GB. Each one opens the launch form, sized.

Llama 13B InferenceBF16 weights (26 GB) on one GPULaunch it QLoRA Fine-tune 30B4-bit weights (about 17 GB) on one GPULaunch it Stable Diffusion XLNative 1024x1024 generation on one GPULaunch it Whisper TranscriptionWhisper Large V3 on one GPULaunch it

Launch it

Ask your agent for an A100 40GB. Or read the call it makes.

Claude Code or Codex runs the runcrate CLI for you: it starts the instance, copies your files over and runs the job. The SDKs make the same request.

Start an A100 40GB on Runcrate called my-gpu, copy train.py to it and run it.

what your agent runsbash

1runcrate instances create --name my-gpu --gpu A100
2#   Instance queued: my-gpu (A100)
3runcrate instances status my-gpu
4runcrate cp ./train.py my-gpu:/root/workspace/
5runcrate ssh my-gpu -- python /root/workspace/train.py

Spec sheet

How the A100 40GB compares. Against its closest alternatives.

FP16 tensor

NVIDIA A100 40GB312 TFLOPS

NVIDIA A100 80GB312 TFLOPS

NVIDIA L40S362 TFLOPS

AMD MI250X383 TFLOPS

Memory

NVIDIA A100 40GB40 GB

NVIDIA A100 80GB80 GB

NVIDIA L40S48 GB

AMD MI250X128 GB

Bandwidth

NVIDIA A100 40GB1.6 TB/s

NVIDIA A100 80GBup to 2.0 TB/s

NVIDIA L40S864 GB/s

AMD MI250X3.3 TB/s

Alternatives

Alternatives to the A100 40GB. Same account, different price and performance.

GPU	Memory · FP16 tensor	Stands out	Price gap	From
NVIDIA A100 40GBThis GPU	40 GB HBM2 · 312 TFLOPS			$1.99/hr
NVIDIA A100 80GB	80 GB HBM2e · 312 TFLOPS	+40 GB memory	-13%	$1.73/hr
NVIDIA L40S	48 GB GDDR6 · 362 TFLOPS		-43%	$1.14/hr
AMD MI250X	128 GB HBM2e · 383 TFLOPS	+88 GB memory		Not on demand
NVIDIA RTX 5090	32 GB GDDR7 · 209.5 TFLOPS	-33% FP16 tensor		Not on demand

Full specs

NVIDIA A100 40GB specifications.

Memory

Memory: 40 GB
Type: HBM2
Bandwidth: 1.6 TB/s

Compute

FP32: 19.5 TFLOPS
FP16 tensor: 312 TFLOPS
INT8: 624 TOPS
Tensor cores: 432
CUDA cores: 6,912

Power and form

TDP: up to 400 W
Architecture: Ampere
Released: 2020

Node

GPUs per node: 8
Maker: NVIDIA

Questions

Renting the A100 40GB. What buyers ask first.

Other GPUs

Browse every GPU by architecture.

NVIDIA Blackwell

NVIDIA Hopper

NVIDIA Ampere

NVIDIA Ada Lovelace

NVIDIA Volta

NVIDIA V100$3.04/hr

AMD Instinct