NVIDIA · Ampere · 2020
NVIDIA A40.
NVIDIA A40 Datacenter GPU — full specifications, performance benchmarks, and live cloud rental pricing.
Available now · 4 regions
From $0.65/hr
Memory
48 GB
GDDR6
Bandwidth
696 GB/s
Memory I/O
FP16
74.8
TFLOPS
TDP
300 W
Ampere
Specs
Full specifications.
GPU Memory48 GB GDDR6
Memory Bandwidth696 GB/s
FP32 Performance37.4 TFLOPS
FP16 Performance74.8 TFLOPS
INT8 Performance299 TOPS
Tensor Cores10,752
CUDA Cores10,752
TDP300 W
ArchitectureAmpere
Form FactorPCIe
NVLinkNo
Max GPUs per Node4
Release Year2020
Alternatives
Other Ampere GPUs.
Same Runcrate platform, different price/performance. Hover any GPU to switch.
NVIDIA A40Current
Ampere · 48GB GDDR6 · 74.8 TFLOPS FP16
NVIDIA RTX A6000
Ampere · 48GB GDDR6 · 77.4 TFLOPS FP16
-7% price
$0.70/hr
AMD MI210
CDNA 2 · 64GB HBM2e · 47.9 TFLOPS FP16
+16GB VRAM+9% price
$0.82/hr
NVIDIA L40S
Ada Lovelace · 48GB GDDR6 · 183 TFLOPS FP16
+145% FP16+13% price
$0.85/hr
NVIDIA RTX 5090
Blackwell · 32GB GDDR7 · 250 TFLOPS FP16
-16GB VRAM-27% price
$0.55/hr
FAQ
Frequently asked.
Rent the NVIDIA A40 on Runcrate.
Available now · 4 regions · per-second billing · from $0.65/hr
Other GPUs