Skip to content

AMD · CDNA 3 · 2023

AMD MI300X. Rental by the hour, on demand.

From $4.85/hr per GPU on an 8-GPU machine, pay as you go with no commitment. 192GB HBM3 in a single GPU, on the open ROCm stack.

MI300X on demand

from$4.85/hr per GPU

on an 8-GPU machine

Availability
Available now · 1 region
Billing
By the second on most GPUs, a few by the minute
8+ GPUs or a month
Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.

The card

192 GB of HBM3. At 5.3 TB/s.

Memory
192 GB
HBM3
Bandwidth
5.3 TB/s
Memory to compute
FP16 tensor
1307.4
TFLOPS
Per node
8 GPUs
Infinity Fabric, 750 W each

Workloads

What teams run on the MI300X. Each one opens the launch form, sized.

Launch it

Ask your agent for an MI300X. Or read the call it makes.

Claude Code or Codex runs it for you: it starts the instance, copies your files over and runs the job. The SDKs make the same request.

Connect your agent first

Add Runcrate's MCP server to yourself: run curl -fsSL "https://runcrate.ai/mcp.md" and follow it.

Add to CursorInstall in VS Code
Works inClaude CodeCodexOpenCodeClineRoo CodeKilo CodeCursor

Start an MI300X on Runcrate called my-gpu, copy train.py to it and run it.

MCP callstext
create_instance { name: "my-gpu", gpu: "MI300X" }
instance_status { id: "my-gpu" }
file_upload { id: "my-gpu", content: "<train.py>", path: "/root/workspace/train.py" }
ssh_execute { id: "my-gpu", command: "nohup python /root/workspace/train.py > train.log 2>&1 &" }

Spec sheet

How the MI300X compares. Against its closest alternatives.

FP16 tensor

AMD MI300X1307.4 TFLOPS
NVIDIA GH200990 TFLOPS
NVIDIA H200989 TFLOPS
NVIDIA H100up to 989 TFLOPS

Memory

AMD MI300X192 GB
NVIDIA GH20096 GB
NVIDIA H200141 GB
NVIDIA H10080 GB

Bandwidth

AMD MI300X5.3 TB/s
NVIDIA GH200up to 4.0 TB/s
NVIDIA H2004.8 TB/s
NVIDIA H100up to 3.4 TB/s

Alternatives

Alternatives to the MI300X. Same account, different price and performance.

GPUMemory · FP16 tensorStands outPrice gapFrom
AMD MI300XThis GPU192 GB HBM3 · 1307.4 TFLOPS$4.85/hr
NVIDIA GH20096 GB HBM3 · 990 TFLOPS-96 GB memoryNot in stock right now
NVIDIA H200141 GB HBM3e · 989 TFLOPS-51 GB memory+6%$5.13/hr
NVIDIA H10080 GB HBM3 · up to 989 TFLOPS-112 GB memory-19%$3.91/hr
NVIDIA H200 NVL141 GB HBM3e · 835 TFLOPS-51 GB memory-4%$4.67/hr

Full specs

AMD MI300X specifications.

Memory

Memory
192 GB
Type
HBM3
Bandwidth
5.3 TB/s

Compute

FP32
163 TFLOPS
FP16 tensor
1307.4 TFLOPS
INT8
2610 TOPS
Stream processors
19,456

Power and form

TDP
750 W
Form factor
OAM
Architecture
CDNA 3
Released
2023

Node

GPUs per node
8
Interconnect
Infinity Fabric
Maker
AMD

Questions

Renting the MI300X. What buyers ask first.

Other GPUs

Browse every GPU by architecture.