Skip to content

NVIDIA · Ampere · 2020

NVIDIA A100 40GB. Rental by the hour, on demand.

From $1.99/hr per GPU on demand, or prepay an 8-GPU machine at $1.90/GPU-hr for 1 month, or one GPU at $1.84/GPU-hr for 3 months.

A100 40GB on demand

from$1.99/hr per GPU
Availability
Available now · 6 regions
By region and size
$1.99 to $4.57/hr
Prepaid
1 mo $1.90/hr3 mo $1.84/hr6 mo $1.78/hr12 mo $1.70/hr
Billing
By the second on most GPUs, a few by the minute
8+ GPUs or a month
Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.

The machine

40 GB of HBM2. At 1.6 TB/s.

Memory
40 GB
HBM2
Bandwidth
1.6 TB/s
Memory to compute
FP16 tensor
312
TFLOPS
Per node
8 GPUs
up to 400 W each

Price across clouds

NVIDIA A100 40GB, cloud by cloud. Sorted by price.

On-demand rates per GPU-hour from each cloud's public price page on 8 Nov 2026: RunPod's Secure Cloud, and Lambda's lowest per-GPU rate across its cluster sizes. Runcrate's row is today's live starting rate.

Runcrate$1.99/hr
Lambda$1.99/hr

Workloads

What teams run on the A100 40GB. Each one opens the launch form, sized.

Launch it

Ask your agent for an A100 40GB. Or read the call it makes.

Claude Code or Codex runs it for you: it starts the instance, copies your files over and runs the job. The SDKs make the same request.

Connect your agent first

Add Runcrate's MCP server to yourself: run curl -fsSL "https://runcrate.ai/mcp.md" and follow it.

Add to CursorInstall in VS Code
Works inClaude CodeCodexOpenCodeClineRoo CodeKilo CodeCursor

Start an A100 40GB on Runcrate called my-gpu, copy train.py to it and run it.

MCP callstext
create_instance { name: "my-gpu", gpu: "A100" }
instance_status { id: "my-gpu" }
file_upload { id: "my-gpu", content: "<train.py>", path: "/root/workspace/train.py" }
ssh_execute { id: "my-gpu", command: "nohup python /root/workspace/train.py > train.log 2>&1 &" }

Spec sheet

How the A100 40GB compares. Against its closest alternatives.

FP16 tensor

NVIDIA A100 40GB312 TFLOPS
NVIDIA A100 80GB312 TFLOPS
NVIDIA L40S362 TFLOPS
AMD MI250X383 TFLOPS

Memory

NVIDIA A100 40GB40 GB
NVIDIA A100 80GB80 GB
NVIDIA L40S48 GB
AMD MI250X128 GB

Bandwidth

NVIDIA A100 40GB1.6 TB/s
NVIDIA A100 80GBup to 2.0 TB/s
NVIDIA L40S864 GB/s
AMD MI250X3.3 TB/s

Alternatives

Alternatives to the A100 40GB. Same account, different price and performance.

GPUMemory · FP16 tensorStands outPrice gapFrom
NVIDIA A100 40GBThis GPU40 GB HBM2 · 312 TFLOPS$1.99/hr
NVIDIA A100 80GB80 GB HBM2e · 312 TFLOPS+40 GB memory-13%$1.73/hr
NVIDIA L40S48 GB GDDR6 · 362 TFLOPS+8%$2.15/hr
AMD MI250X128 GB HBM2e · 383 TFLOPS+88 GB memoryNot in stock right now
NVIDIA RTX 509032 GB GDDR7-53%$0.93/hr

Full specs

NVIDIA A100 40GB specifications.

Memory

Memory
40 GB
Type
HBM2
Bandwidth
1.6 TB/s

Compute

FP32
19.5 TFLOPS
FP16 tensor
312 TFLOPS
INT8
624 TOPS
Tensor cores
432
CUDA cores
6,912

Power and form

TDP
up to 400 W
Architecture
Ampere
Released
2020

Node

GPUs per node
8
Maker
NVIDIA

Questions

Renting the A100 40GB. What buyers ask first.

Other GPUs

Browse every GPU by architecture.