NVIDIA A100 40GB vs AMD MI300X: which is better for AI?

Choose NVIDIA A100 40GB if you want the Ampere architecture. Choose AMD MI300X if you need 192GB+ on a single GPU (152GB more than NVIDIA A100 40GB).

Can I deploy NVIDIA A100 40GB or AMD MI300X on Runcrate today?

NVIDIA A100 40GB is on demand in 5 regions from $1.99/hr, billed by the second on most GPUs. AMD MI300X is available as reserved capacity on request.

How much VRAM does each GPU have?

NVIDIA A100 40GB has 40GB HBM2. AMD MI300X has 192GB HBM3.

GPU comparison

NVIDIA A100 40GB vs AMD MI300X.

Specs, performance and live cloud availability, side by side.

Launch A100 40GB Get a reserved quote

The short answer

Choose NVIDIA A100 40GB if you want the Ampere architecture.
Choose AMD MI300X if you need 192GB+ on a single GPU (152GB more than NVIDIA A100 40GB).

Compare another pair

Ampere

NVIDIA A100 40GB

from$1.99/hr

Available now · 5 regions

Memory: 40 GB HBM2
FP16 tensor: 312 TFLOPS
Bandwidth: 1.6 TB/s

Launch A100 40GB Get a reserved quote

Full pricing details

CDNA 3

AMD MI300X

Reserved capacity · on request

Memory: 192 GB HBM3
FP16 tensor: 1307.4 TFLOPS
Bandwidth: 5.3 TB/s

Reserve capacity Deploy H200 instead

Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA A100 40GB40 GB

AMD MI300X192 GB

Memory bandwidth

NVIDIA A100 40GB1.6 TB/s

AMD MI300X5.3 TB/s

FP16 tensor

NVIDIA A100 40GB312 TFLOPS

AMD MI300X1307.4 TFLOPS

FP32

NVIDIA A100 40GB19.5 TFLOPS

AMD MI300X163 TFLOPS

Full specs

The complete spec sheet.

Spec	NVIDIA A100 40GB	AMD MI300X
Architecture	Ampere	CDNA 3
Memory	40 GB	192 GB
Memory type	HBM2	HBM3
Memory bandwidth	1.6 TB/s	5.3 TB/s
FP32	19.5 TFLOPS	163 TFLOPS
FP16 tensor	312 TFLOPS	1307.4 TFLOPS
INT8	624 TOPS	2610 TOPS
TDP	up to 400 W	750 W
GPUs per node	8	8
Hourly price (live)	from $1.99/hr	Reserve on request

Questions

A100 40GB or MI300X. What buyers ask first.