GPU comparison
NVIDIA H100 vs AMD MI250X.
Specs, performance and live cloud availability, side by side.
The short answer
Choose AMD MI250X if you need 128GB+ on a single GPU (48GB more than NVIDIA H100).
Choose NVIDIA H100 if you need FP16 tensor throughput (158% faster than AMD MI250X).
Compare another pair
vs
Hopper
NVIDIA H100
from$4.29/hr
Available now · 4 regions- Memory
- 80 GB HBM3
- FP16 tensor
- up to 989 TFLOPS
- Bandwidth
- up to 3.4 TB/s
CDNA 2
AMD MI250X
Not on demand yet- Memory
- 128 GB HBM2e
- FP16 tensor
- 383 TFLOPS
- Bandwidth
- 3.3 TB/s
At a glance
Spec by spec. The longer bar is the better number.
Full specs
The complete spec sheet.
| Spec | NVIDIA H100 | AMD MI250X |
|---|---|---|
| Architecture | Hopper | CDNA 2 |
| Memory | 80 GB | 128 GB |
| Memory type | HBM3 | HBM2e |
| Memory bandwidth | up to 3.4 TB/s | 3.3 TB/s |
| FP32 | up to 67 TFLOPS | 47.9 TFLOPS |
| FP16 tensor | up to 989 TFLOPS | 383 TFLOPS |
| INT8 | up to 2400 TOPS | 383 TOPS |
| TDP | up to 700 W | 560 W |
| GPUs per node | 8 | 8 |
| Hourly price (live) | from $4.29/hr | Not on demand yet |
Questions
H100 or MI250X. What buyers ask first.
Other comparisons