GPU comparison
MI300X vs MI210.
The MI300X is ahead on memory (192 GB vs 64 GB) and speed (7.2x the FP16 throughput and 3.2x the memory bandwidth). The MI210 makes sense when your model fits in 64 GB and its hourly price is lower.
Rent either on Runcrate
- MI300Xfrom $4.85/hr per GPU
on an 8-GPU machine
$0.025 per GB/hr$0.37 per 100 TFLOPS/hr
- MI210Not in stock right now
Live hourly price, then per GB of memory and per 100 FP16 TFLOPS.
Which is better for
Which to pick for each job. Memory fit and throughput, from the datasheets.
Hold a 70B model in 8-bit weights
70 GB of 8-bit weights
MI300X: 1 GPU, 122 GB spare
MI210: 2 GPUs (128 GB)
MI300X. Fits on one GPU.
Serve an 8B model in 16-bit weights
16 GB of 16-bit weights
MI300X: 1 GPU, 176 GB spare
MI210: 1 GPU, 48 GB spare
MI300X. Same GPU count, 3.2x the memory bandwidth.
Fine-tune a 70B model with QLoRA
About 46 GB with 4-bit weights
MI300X: 1 GPU, 146 GB spare
MI210: 1 GPU, 18 GB spare
MI300X. Same GPU count, 7.2x the FP16 throughput.
Train on a full node
FP16 tensor throughput per node
MI300X: 8x, 10,459 TFLOPS
MI210: 4x, 724 TFLOPS
MI300X. 8 GPUs per node, not 4.
Throughput per watt
FP16 TFLOPS per 100 W of TDP
MI300X: 174 TFLOPS per 100 W
MI210: 60 TFLOPS per 100 W
MI300X. 2.9x the FP16 per watt.
Compare another pair
CDNA 3
AMD MI300X
on an 8-GPU machine
- Memory
- 192 GB HBM3
- FP16 tensor
- 1307.4 TFLOPS
- Bandwidth
- 5.3 TB/s
CDNA 2
AMD MI210
- Memory
- 64 GB HBM2e
- FP16 tensor
- 181 TFLOPS
- Bandwidth
- 1.6 TB/s
At a glance
Spec by spec. The longer bar is the better number.
Full specs
The complete spec sheet.
| Spec | AMD MI300X | AMD MI210 |
|---|---|---|
| Architecture | CDNA 3 | CDNA 2 |
| Memory | 192 GB | 64 GB |
| Memory type | HBM3 | HBM2e |
| Memory bandwidth | 5.3 TB/s | 1.6 TB/s |
| FP32 | 163 TFLOPS | 23.9 TFLOPS |
| FP16 tensor | 1307.4 TFLOPS | 181 TFLOPS |
| INT8 | 2610 TOPS | 192 TOPS |
| TDP | 750 W | 300 W |
| Form factor | OAM | PCIe |
| NVLink | No | No |
| GPUs per node | 8 | 4 |
| Hourly price (live) | from $4.85/hr per GPU on an 8-GPU machine | Not in stock right now |
Questions
MI300X or MI210. What buyers ask first.
Other comparisons