GPU comparison
NVIDIA A100 40GB vs AMD MI250X.
Specs, performance and live cloud availability, side by side.
The short answer
Choose NVIDIA A100 40GB if you want the Ampere architecture.
Choose AMD MI250X if you need 128GB+ on a single GPU (88GB more than NVIDIA A100 40GB).
Compare another pair
vs
Ampere
NVIDIA A100 40GB
from$1.99/hr
Available now · 5 regions- Memory
- 40 GB HBM2
- FP16 tensor
- 312 TFLOPS
- Bandwidth
- 1.6 TB/s
CDNA 2
AMD MI250X
Not on demand yet- Memory
- 128 GB HBM2e
- FP16 tensor
- 383 TFLOPS
- Bandwidth
- 3.3 TB/s
At a glance
Spec by spec. The longer bar is the better number.
Full specs
The complete spec sheet.
| Spec | NVIDIA A100 40GB | AMD MI250X |
|---|---|---|
| Architecture | Ampere | CDNA 2 |
| Memory | 40 GB | 128 GB |
| Memory type | HBM2 | HBM2e |
| Memory bandwidth | 1.6 TB/s | 3.3 TB/s |
| FP32 | 19.5 TFLOPS | 47.9 TFLOPS |
| FP16 tensor | 312 TFLOPS | 383 TFLOPS |
| INT8 | 624 TOPS | 383 TOPS |
| TDP | up to 400 W | 560 W |
| GPUs per node | 8 | 8 |
| Hourly price (live) | from $1.99/hr | Not on demand yet |
Questions
A100 40GB or MI250X. What buyers ask first.
Other comparisons