Skip to content

GPU comparison

RTX 4090 vs MI210.

Pick the MI210 for memory: 64 GB vs 24 GB, with 63% more memory bandwidth. A QLoRA fine-tune of a 70B model (about 46 GB) fits on one MI210, not on one RTX 4090. For models under 24 GB pick by price.

Rent either on Runcrate

Live hourly price, then per GB of memory.

Which is better for

Which to pick for each job. Memory fit, from the datasheets.

  • Hold a 70B model in 8-bit weights

    70 GB of 8-bit weights

    RTX 4090: 4 GPUs, more than one 2x node

    MI210: 2 GPUs (128 GB)

    MI210. Fits in one node (2 GPUs).

  • Serve an 8B model in 16-bit weights

    16 GB of 16-bit weights

    RTX 4090: 1 GPU, 8 GB spare

    MI210: 1 GPU, 48 GB spare

    MI210. Same GPU count, 63% more memory bandwidth.

  • Fine-tune a 70B model with QLoRA

    About 46 GB with 4-bit weights

    RTX 4090: 2 GPUs (48 GB)

    MI210: 1 GPU, 18 GB spare

    MI210. Fits on one GPU.

Compare another pair

vs

Ada Lovelace

NVIDIA RTX 4090

from$0.58/hr
Available now · 5 regions
Memory
24 GB GDDR6X
Bandwidth
1.0 TB/s
Full pricing details

CDNA 2

AMD MI210

Not in stock right now
Memory
64 GB HBM2e
Bandwidth
1.6 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA RTX 409024 GB
AMD MI21064 GB

Memory bandwidth

NVIDIA RTX 40901.0 TB/s
AMD MI2101.6 TB/s

Full specs

The complete spec sheet.

SpecNVIDIA RTX 4090AMD MI210
ArchitectureAda LovelaceCDNA 2
Memory24 GB64 GB
Memory typeGDDR6XHBM2e
Memory bandwidth1.0 TB/s1.6 TB/s
FP3282.6 TFLOPS23.9 TFLOPS
FP16165.2 TFLOPS, non-tensor181 TFLOPS, tensor
INT8661 TOPS192 TOPS
TDP450 W300 W
Form factorConsumerPCIe
NVLinkNoNo
GPUs per node24
Hourly price (live)from $0.58/hrNot in stock right now

Questions

RTX 4090 or MI210. What buyers ask first.

Other comparisons

More pairs with the RTX 4090 or the MI210.