NVIDIA A100 80GB vs AMD MI250X: which is better for AI?

Choose NVIDIA A100 80GB if you want the Ampere architecture. Choose AMD MI250X if you need 128GB+ on a single GPU (48GB more than NVIDIA A100 80GB).

Can I deploy NVIDIA A100 80GB or AMD MI250X on Runcrate today?

NVIDIA A100 80GB is on demand in 6 regions from $1.73/hr, billed by the second on most GPUs. AMD MI250X is not on demand on Runcrate yet; leave your email on its pricing page to register interest.

How much VRAM does each GPU have?

NVIDIA A100 80GB has 80GB HBM2e. AMD MI250X has 128GB HBM2e.

GPU comparison

NVIDIA A100 80GB vs AMD MI250X.

Specs, performance and live cloud availability, side by side.

Launch A100 80GB Get a reserved quote

The short answer

Choose NVIDIA A100 80GB if you want the Ampere architecture.
Choose AMD MI250X if you need 128GB+ on a single GPU (48GB more than NVIDIA A100 80GB).

Compare another pair

Ampere

NVIDIA A100 80GB

from$1.73/hr

Available now · 6 regions

Memory: 80 GB HBM2e
FP16 tensor: 312 TFLOPS
Bandwidth: up to 2.0 TB/s

Launch A100 80GB Get a reserved quote

Full pricing details

CDNA 2

AMD MI250X

Not on demand yet

Memory: 128 GB HBM2e
FP16 tensor: 383 TFLOPS
Bandwidth: 3.3 TB/s

Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA A100 80GB80 GB

AMD MI250X128 GB

Memory bandwidth

NVIDIA A100 80GBup to 2.0 TB/s

AMD MI250X3.3 TB/s

FP16 tensor

NVIDIA A100 80GB312 TFLOPS

AMD MI250X383 TFLOPS

FP32

NVIDIA A100 80GB19.5 TFLOPS

AMD MI250X47.9 TFLOPS

Full specs

The complete spec sheet.

Spec	NVIDIA A100 80GB	AMD MI250X
Architecture	Ampere	CDNA 2
Memory	80 GB	128 GB
Memory type	HBM2e	HBM2e
Memory bandwidth	up to 2.0 TB/s	3.3 TB/s
FP32	19.5 TFLOPS	47.9 TFLOPS
FP16 tensor	312 TFLOPS	383 TFLOPS
INT8	624 TOPS	383 TOPS
TDP	up to 400 W	560 W
GPUs per node	8	8
Hourly price (live)	from $1.73/hr	Not on demand yet

Questions

A100 80GB or MI250X. What buyers ask first.