GPU Comparison
NVIDIA A40 vs NVIDIA V100.
Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA V100 is the cheaper option at $0.55/hr.
TL;DR
Choose NVIDIA A40 if you need 48GB+ on a single GPU (16GB more than NVIDIA V100).
Choose NVIDIA A40 if you need raw FP16 throughput (138% faster than NVIDIA V100).
Switch comparison
vs
Ampere
NVIDIA A40
$0.75/hr
$0.65-$0.85/hr range · 4 regions
VRAM48GB GDDR6
FP1674.8 TFLOPS
Bandwidth696 GB/s
Volta
NVIDIA V100
$0.55/hrCheaper
$0.45-$0.65/hr range · 4 regions
VRAM32GB HBM2
FP1631.4 TFLOPS
Bandwidth900 GB/s
At a glance
Spec by spec.
Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.
VRAM
NVIDIA A40
48 GB
NVIDIA V100
32 GB
Memory Bandwidth
NVIDIA A40
696 GB/s
NVIDIA V100
900 GB/s
FP16 Performance
NVIDIA A40
74.8 TFLOPS
NVIDIA V100
31.4 TFLOPS
Hourly Price
NVIDIA A40
$0.75/hr
NVIDIA V100
$0.55/hr
Full specs
Complete spec sheet.
SpecNVIDIA A40NVIDIA V100
ArchitectureAmpereVolta
VRAM48 GB●32 GB
Memory TypeGDDR6HBM2
Memory Bandwidth696 GB/s900 GB/s●
FP32 Performance37.4 TFLOPS●15.7 TFLOPS
FP16 Performance74.8 TFLOPS●31.4 TFLOPS
INT8 Performance299 TOPS●125 TOPS
TDP300 W300 W
Form FactorPCIePCIe
NVLinkNoYes
Max GPU/Node48
Hourly Price$0.75/hr$0.55/hr●
FAQ
Frequently asked.
Pick a GPU and deploy.
Both GPUs available on Runcrate · per-second billing · no commitments
Other comparisons