Skip to content

GPU comparison

MI250X vs MI210.

The MI250X is ahead on memory (128 GB vs 64 GB) and speed (2.1x the FP16 throughput and 2.0x the memory bandwidth). The MI210 makes sense when your model fits in 64 GB and its hourly price is lower.

Rent either on Runcrate

Which is better for

Which to pick for each job. Memory fit and throughput, from the datasheets.

  • Hold a 70B model in 8-bit weights

    70 GB of 8-bit weights

    MI250X: 1 GPU, 58 GB spare

    MI210: 2 GPUs (128 GB)

    MI250X. Fits on one GPU.

  • Serve an 8B model in 16-bit weights

    16 GB of 16-bit weights

    MI250X: 1 GPU, 112 GB spare

    MI210: 1 GPU, 48 GB spare

    MI250X. Same GPU count, 2.0x the memory bandwidth.

  • Fine-tune a 70B model with QLoRA

    About 46 GB with 4-bit weights

    MI250X: 1 GPU, 82 GB spare

    MI210: 1 GPU, 18 GB spare

    MI250X. Same GPU count, 2.1x the FP16 throughput.

  • Train on a full node

    FP16 tensor throughput per node

    MI250X: 8x, 3,064 TFLOPS

    MI210: 4x, 724 TFLOPS

    MI250X. 8 GPUs per node, not 4.

  • Throughput per watt

    FP16 TFLOPS per 100 W of TDP

    MI250X: 68 TFLOPS per 100 W

    MI210: 60 TFLOPS per 100 W

    Either. Close per watt.

Compare another pair

vs

CDNA 2

AMD MI250X

Not in stock right now
Memory
128 GB HBM2e
FP16 tensor
383 TFLOPS
Bandwidth
3.3 TB/s
Full pricing details

CDNA 2

AMD MI210

Not in stock right now
Memory
64 GB HBM2e
FP16 tensor
181 TFLOPS
Bandwidth
1.6 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

AMD MI250X128 GB
AMD MI21064 GB

Memory bandwidth

AMD MI250X3.3 TB/s
AMD MI2101.6 TB/s

FP16 tensor

AMD MI250X383 TFLOPS
AMD MI210181 TFLOPS

FP32

AMD MI250X47.9 TFLOPS
AMD MI21023.9 TFLOPS

Full specs

The complete spec sheet.

SpecAMD MI250XAMD MI210
ArchitectureCDNA 2CDNA 2
Memory128 GB64 GB
Memory typeHBM2eHBM2e
Memory bandwidth3.3 TB/s1.6 TB/s
FP3247.9 TFLOPS23.9 TFLOPS
FP16 tensor383 TFLOPS181 TFLOPS
INT8383 TOPS192 TOPS
TDP560 W300 W
Form factorOAMPCIe
NVLinkNoNo
GPUs per node84
Hourly price (live)Not in stock right nowNot in stock right now

Questions

MI250X or MI210. What buyers ask first.

Other comparisons

More pairs with the MI250X or the MI210.