Skip to content

GPU comparison

NVIDIA A100 80GB vs AMD MI300X.

Specs, performance and live cloud availability, side by side.

The short answer

  • Choose NVIDIA A100 80GB if you want the Ampere architecture.

  • Choose AMD MI300X if you need 192GB+ on a single GPU (112GB more than NVIDIA A100 80GB).

Compare another pair

vs
NVIDIA

Ampere

NVIDIA A100 80GB

from$1.73/hr
Available now · 6 regions
Memory
80 GB HBM2e
FP16 tensor
312 TFLOPS
Bandwidth
up to 2.0 TB/s
Full pricing details
AMD

CDNA 3

AMD MI300X

Reserved capacity · on request
Memory
192 GB HBM3
FP16 tensor
1307.4 TFLOPS
Bandwidth
5.3 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA A100 80GB80 GB
AMD MI300X192 GB

Memory bandwidth

NVIDIA A100 80GBup to 2.0 TB/s
AMD MI300X5.3 TB/s

FP16 tensor

NVIDIA A100 80GB312 TFLOPS
AMD MI300X1307.4 TFLOPS

FP32

NVIDIA A100 80GB19.5 TFLOPS
AMD MI300X163 TFLOPS

Full specs

The complete spec sheet.

SpecNVIDIA A100 80GBAMD MI300X
ArchitectureAmpereCDNA 3
Memory80 GB192 GB
Memory typeHBM2eHBM3
Memory bandwidthup to 2.0 TB/s5.3 TB/s
FP3219.5 TFLOPS163 TFLOPS
FP16 tensor312 TFLOPS1307.4 TFLOPS
INT8624 TOPS2610 TOPS
TDPup to 400 W750 W
GPUs per node88
Hourly price (live)from $1.73/hrReserve on request

Questions

A100 80GB or MI300X. What buyers ask first.

Other comparisons

More pairs with the NVIDIA A100 80GB.