GPU comparison
NVIDIA A100 80GB vs NVIDIA A40.
Specs, performance and live cloud availability, side by side. The NVIDIA A100 80GB is cheaper today, from $1.73/hr.
The short answer
Choose NVIDIA A100 80GB if you need 80GB+ on a single GPU (32GB more than NVIDIA A40).
Choose NVIDIA A100 80GB if you need FP16 tensor throughput (108% faster than NVIDIA A40).
Compare another pair
vs
Ampere
NVIDIA A100 80GB
from$1.73/hrCheaper
Available now · 6 regions- Memory
- 80 GB HBM2e
- FP16 tensor
- 312 TFLOPS
- Bandwidth
- up to 2.0 TB/s
Ampere
NVIDIA A40
from$2.42/hr
Available now · 6 regions- Memory
- 48 GB GDDR6
- FP16 tensor
- 149.7 TFLOPS
- Bandwidth
- 696 GB/s
At a glance
Spec by spec. The longer bar is the better number.
Full specs
The complete spec sheet.
| Spec | NVIDIA A100 80GB | NVIDIA A40 |
|---|---|---|
| Architecture | Ampere | Ampere |
| Memory | 80 GB | 48 GB |
| Memory type | HBM2e | GDDR6 |
| Memory bandwidth | up to 2.0 TB/s | 696 GB/s |
| FP32 | 19.5 TFLOPS | 37.4 TFLOPS |
| FP16 tensor | 312 TFLOPS | 149.7 TFLOPS |
| INT8 | 624 TOPS | 299 TOPS |
| TDP | up to 400 W | 300 W |
| GPUs per node | 8 | 4 |
| Hourly price (live) | from $1.73/hr | from $2.42/hr |
Questions
A100 80GB or A40. What buyers ask first.
Other comparisons