Skip to content

GPU comparison

A100 80GB vs MI210.

The A100 80GB is ahead on memory (80 GB vs 64 GB) and speed (72% more FP16 throughput and up to 24% more memory bandwidth). The MI210 makes sense when your model fits in 64 GB and its hourly price is lower.

Rent either on Runcrate

Live hourly price, then per GB of memory and per 100 FP16 TFLOPS.

Which is better for

Which to pick for each job. Memory fit and throughput, from the datasheets.

  • Hold a 70B model in 8-bit weights

    70 GB of 8-bit weights

    A100 80GB: 1 GPU, 10 GB spare

    MI210: 2 GPUs (128 GB)

    A100 80GB. Fits on one GPU.

  • Serve an 8B model in 16-bit weights

    16 GB of 16-bit weights

    A100 80GB: 1 GPU, 64 GB spare

    MI210: 1 GPU, 48 GB spare

    A100 80GB. Same GPU count, up to 24% more memory bandwidth.

  • Fine-tune a 70B model with QLoRA

    About 46 GB with 4-bit weights

    A100 80GB: 1 GPU, 34 GB spare

    MI210: 1 GPU, 18 GB spare

    A100 80GB. Same GPU count, 72% more FP16 throughput.

  • Train on a full node

    FP16 tensor throughput per node

    A100 80GB: 8x, 2,496 TFLOPS

    MI210: 4x, 724 TFLOPS

    A100 80GB. 8 GPUs per node, not 4.

  • Throughput per watt

    FP16 TFLOPS per 100 W of TDP

    A100 80GB: Varies by card

    MI210: 60 TFLOPS per 100 W

    Either. Varies by card.

Compare another pair

vs

Ampere

NVIDIA A100 80GB

from$1.73/hr
Available now · 6 regions
Memory
80 GB HBM2e
FP16 tensor
312 TFLOPS
Bandwidth
up to 2.0 TB/s
Full pricing details

CDNA 2

AMD MI210

Not in stock right now
Memory
64 GB HBM2e
FP16 tensor
181 TFLOPS
Bandwidth
1.6 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA A100 80GB80 GB
AMD MI21064 GB

Memory bandwidth

NVIDIA A100 80GBup to 2.0 TB/s
AMD MI2101.6 TB/s

FP16 tensor

NVIDIA A100 80GB312 TFLOPS
AMD MI210181 TFLOPS

FP32

NVIDIA A100 80GB19.5 TFLOPS
AMD MI21023.9 TFLOPS

Full specs

The complete spec sheet.

SpecNVIDIA A100 80GBAMD MI210
ArchitectureAmpereCDNA 2
Memory80 GB64 GB
Memory typeHBM2eHBM2e
Memory bandwidthup to 2.0 TB/s1.6 TB/s
FP3219.5 TFLOPS23.9 TFLOPS
FP16 tensor312 TFLOPS181 TFLOPS
INT8624 TOPS192 TOPS
TDPup to 400 W300 W
GPUs per node84
Hourly price (live)from $1.73/hrNot in stock right now

Questions

A100 80GB or MI210. What buyers ask first.

Other comparisons

More pairs with the A100 80GB or the MI210.