Skip to content

AMD · CDNA 3 · 2023

AMD MI300X. 192 GB HBM3, 1307.4 TFLOPS FP16 tensor.

192GB HBM3 in a single GPU, on the open ROCm stack.

MI300X on demand

from$4.85/hr per GPU

on an 8-GPU machine

Availability
Available now · 1 region
Billing
By the second on most GPUs, a few by the minute
8+ GPUs or a month
Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.

The card

192 GB of HBM3. At 5.3 TB/s.

Memory
192 GB
HBM3
Bandwidth
5.3 TB/s
Memory to compute
FP16 tensor
1307.4
TFLOPS
Per node
8 GPUs
Infinity Fabric, 750 W each

Workloads

What teams run on the MI300X. Each one opens the launch form, sized.

Full specs

AMD MI300X specifications.

Memory

Memory
192 GB
Type
HBM3
Bandwidth
5.3 TB/s

Compute

FP32
163 TFLOPS
FP16 tensor
1307.4 TFLOPS
INT8
2610 TOPS
Stream processors
19,456

Power and form

TDP
750 W
Form factor
OAM
Architecture
CDNA 3
Released
2023

Node

GPUs per node
8
Interconnect
Infinity Fabric
Maker
AMD

Alternatives

Alternatives to the MI300X. Same account, different price and performance.

GPUMemory · FP16 tensorStands outPrice gapFrom
AMD MI300XThis GPU192 GB HBM3 · 1307.4 TFLOPS$4.85/hr
NVIDIA GH20096 GB HBM3 · 990 TFLOPS-96 GB memoryNot in stock right now
NVIDIA H200141 GB HBM3e · 989 TFLOPS-51 GB memory+6%$5.13/hr
NVIDIA H10080 GB HBM3 · up to 989 TFLOPS-112 GB memory-19%$3.91/hr
NVIDIA H200 NVL141 GB HBM3e · 835 TFLOPS-51 GB memory-4%$4.67/hr

Questions

Renting the MI300X. What buyers ask first.

Other GPUs

Browse every GPU by architecture.