GPU Comparison

NVIDIA RTX 3090 vs AMD MI250X.

Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA RTX 3090 is the cheaper option at $0.22/hr.

TL;DR

Choose AMD MI250X if you need 128GB+ on a single GPU (104GB more than NVIDIA RTX 3090).

Choose AMD MI250X if you need raw FP16 throughput (35% faster than NVIDIA RTX 3090).

Switch comparison

vs
NVIDIA

Ampere

NVIDIA RTX 3090

$0.22/hrCheaper

$0.12-$0.28/hr range · 4 regions

VRAM24GB GDDR6X
FP1671 TFLOPS
Bandwidth936 GB/s
Deploy NVIDIA RTX 3090Full pricing details
AMD

CDNA 2

AMD MI250X

$1.35/hr

$1.20-$1.50/hr range · 4 regions

VRAM128GB HBM2e
FP1695.7 TFLOPS
Bandwidth3.3 TB/s
Deploy AMD MI250XFull pricing details

At a glance

Spec by spec.

Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.

VRAM

NVIDIA RTX 3090
24 GB
AMD MI250X
128 GB

Memory Bandwidth

NVIDIA RTX 3090
936 GB/s
AMD MI250X
3.3 TB/s

FP16 Performance

NVIDIA RTX 3090
71 TFLOPS
AMD MI250X
95.7 TFLOPS

Hourly Price

NVIDIA RTX 3090
$0.22/hr
AMD MI250X
$1.35/hr

Full specs

Complete spec sheet.

SpecNVIDIA RTX 3090AMD MI250X
ArchitectureAmpereCDNA 2
VRAM24 GB128 GB
Memory TypeGDDR6XHBM2e
Memory Bandwidth936 GB/s3.3 TB/s
FP32 Performance35.6 TFLOPS47.9 TFLOPS
FP16 Performance71 TFLOPS95.7 TFLOPS
INT8 Performance284 TOPS383 TOPS
TDP350 W560 W
Form FactorConsumerOAM
NVLinkYesNo
Max GPU/Node28
Hourly Price$0.22/hr$1.35/hr

FAQ

Frequently asked.

Pick a GPU and deploy.

Both GPUs available on Runcrate · per-second billing · no commitments

Other comparisons