NVIDIA · Ampere · 2020
NVIDIA A100 40GB. Rental by the hour, on demand.
From $1.99/hr per GPU on demand, or prepay an 8-GPU machine at $1.90/GPU-hr for 1 month, or one GPU at $1.84/GPU-hr for 3 months.
A100 40GB on demand
- Availability
- Available now · 6 regions
- By region and size
- $1.99 to $4.57/hr
- Prepaid
- 1 mo $1.90/hr3 mo $1.84/hr6 mo $1.78/hr12 mo $1.70/hr
- Billing
- By the second on most GPUs, a few by the minute
- 8+ GPUs or a month
- Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.
The machine
40 GB of HBM2. At 1.6 TB/s.
- Memory
- 40 GB
- HBM2
- Bandwidth
- 1.6 TB/s
- Memory to compute
- FP16 tensor
- 312
- TFLOPS
- Per node
- 8 GPUs
- up to 400 W each
Price across clouds
NVIDIA A100 40GB, cloud by cloud. Sorted by price.
On-demand rates per GPU-hour from each cloud's public price page on 8 Nov 2026: RunPod's Secure Cloud, and Lambda's lowest per-GPU rate across its cluster sizes. Runcrate's row is today's live starting rate.
Workloads
What teams run on the A100 40GB. Each one opens the launch form, sized.
Launch it
Ask your agent for an A100 40GB. Or read the call it makes.
Claude Code or Codex runs it for you: it starts the instance, copies your files over and runs the job. The SDKs make the same request.
Connect your agent first
Add Runcrate's MCP server to yourself: run curl -fsSL "https://runcrate.ai/mcp.md" and follow it.
Start an A100 40GB on Runcrate called my-gpu, copy train.py to it and run it.
create_instance { name: "my-gpu", gpu: "A100" }instance_status { id: "my-gpu" }file_upload { id: "my-gpu", content: "<train.py>", path: "/root/workspace/train.py" }ssh_execute { id: "my-gpu", command: "nohup python /root/workspace/train.py > train.log 2>&1 &" }Spec sheet
How the A100 40GB compares. Against its closest alternatives.
Alternatives
Alternatives to the A100 40GB. Same account, different price and performance.
| GPU | Memory · FP16 tensor | Stands out | Price gap | From |
|---|---|---|---|---|
| NVIDIA A100 40GBThis GPU | 40 GB HBM2 · 312 TFLOPS | $1.99/hr | ||
| NVIDIA A100 80GB | 80 GB HBM2e · 312 TFLOPS | +40 GB memory | -13% | $1.73/hr |
| NVIDIA L40S | 48 GB GDDR6 · 362 TFLOPS | +8% | $2.15/hr | |
| AMD MI250X | 128 GB HBM2e · 383 TFLOPS | +88 GB memory | Not in stock right now | |
| NVIDIA RTX 5090 | 32 GB GDDR7 | -53% | $0.93/hr |
Full specs
NVIDIA A100 40GB specifications.
Memory
- Memory
- 40 GB
- Type
- HBM2
- Bandwidth
- 1.6 TB/s
Compute
- FP32
- 19.5 TFLOPS
- FP16 tensor
- 312 TFLOPS
- INT8
- 624 TOPS
- Tensor cores
- 432
- CUDA cores
- 6,912
Power and form
- TDP
- up to 400 W
- Architecture
- Ampere
- Released
- 2020
Node
- GPUs per node
- 8
- Maker
- NVIDIA
Questions
Renting the A100 40GB. What buyers ask first.
Other GPUs
Browse every GPU by architecture.
NVIDIA Blackwell
NVIDIA Hopper
NVIDIA Ampere
NVIDIA Ada Lovelace
NVIDIA Volta