NVIDIA H100 vs AMD MI300X: which is better for AI?

Choose NVIDIA H100 if you want the Hopper architecture. Choose AMD MI300X if you need 192GB+ on a single GPU (112GB more than NVIDIA H100).

Can I deploy NVIDIA H100 or AMD MI300X on Runcrate today?

NVIDIA H100 is on demand in 4 regions from $4.29/hr, billed by the second on most GPUs. AMD MI300X is available as reserved capacity on request.

How much VRAM does each GPU have?

NVIDIA H100 has 80GB HBM3. AMD MI300X has 192GB HBM3.

GPU comparison

NVIDIA H100 vs AMD MI300X.

Specs, performance and live cloud availability, side by side.

Launch H100 Get a reserved quote

The short answer

Choose NVIDIA H100 if you want the Hopper architecture.
Choose AMD MI300X if you need 192GB+ on a single GPU (112GB more than NVIDIA H100).

Compare another pair

Hopper

NVIDIA H100

from$4.29/hr

Available now · 4 regions

Memory: 80 GB HBM3
FP16 tensor: up to 989 TFLOPS
Bandwidth: up to 3.4 TB/s

Launch H100 Get a reserved quote

Full pricing details

CDNA 3

AMD MI300X

Reserved capacity · on request

Memory: 192 GB HBM3
FP16 tensor: 1307.4 TFLOPS
Bandwidth: 5.3 TB/s

Reserve capacity Deploy H200 instead

Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA H10080 GB

AMD MI300X192 GB

Memory bandwidth

NVIDIA H100up to 3.4 TB/s

AMD MI300X5.3 TB/s

FP16 tensor

NVIDIA H100up to 989 TFLOPS

AMD MI300X1307.4 TFLOPS

FP32

NVIDIA H100up to 67 TFLOPS

AMD MI300X163 TFLOPS

Full specs

The complete spec sheet.

Spec	NVIDIA H100	AMD MI300X
Architecture	Hopper	CDNA 3
Memory	80 GB	192 GB
Memory type	HBM3	HBM3
Memory bandwidth	up to 3.4 TB/s	5.3 TB/s
FP32	up to 67 TFLOPS	163 TFLOPS
FP16 tensor	up to 989 TFLOPS	1307.4 TFLOPS
INT8	up to 2400 TOPS	2610 TOPS
TDP	up to 700 W	750 W
GPUs per node	8	8
Hourly price (live)	from $4.29/hr	Reserve on request

Questions

H100 or MI300X. What buyers ask first.