GPU comparison
NVIDIA A100 40GB vs NVIDIA V100.
Specs, performance and live cloud availability, side by side. The NVIDIA A100 40GB is cheaper today, from $1.99/hr.
The short answer
Choose NVIDIA A100 40GB if you need 40GB+ on a single GPU (8GB more than NVIDIA V100).
Choose NVIDIA A100 40GB if you need FP16 tensor throughput (150% faster than NVIDIA V100).
Compare another pair
vs
Ampere
NVIDIA A100 40GB
from$1.99/hrCheaper
Available now · 5 regions- Memory
- 40 GB HBM2
- FP16 tensor
- 312 TFLOPS
- Bandwidth
- 1.6 TB/s
Volta
NVIDIA V100
from$3.04/hr
Available now · 1 region- Memory
- 32 GB HBM2
- FP16 tensor
- 125 TFLOPS
- Bandwidth
- 900 GB/s
At a glance
Spec by spec. The longer bar is the better number.
Full specs
The complete spec sheet.
| Spec | NVIDIA A100 40GB | NVIDIA V100 |
|---|---|---|
| Architecture | Ampere | Volta |
| Memory | 40 GB | 32 GB |
| Memory type | HBM2 | HBM2 |
| Memory bandwidth | 1.6 TB/s | 900 GB/s |
| FP32 | 19.5 TFLOPS | 15.7 TFLOPS |
| FP16 tensor | 312 TFLOPS | 125 TFLOPS |
| INT8 | 624 TOPS | 125 TOPS |
| TDP | up to 400 W | 300 W |
| GPUs per node | 8 | 8 |
| Hourly price (live) | from $1.99/hr | from $3.04/hr |
Questions
A100 40GB or V100. What buyers ask first.
Other comparisons