GPU Comparison

NVIDIA V100 vs AMD MI250X.

Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA V100 is the cheaper option at $0.55/hr.

TL;DR

Choose AMD MI250X if you need 128GB+ on a single GPU (96GB more than NVIDIA V100).

Choose AMD MI250X if you need raw FP16 throughput (205% faster than NVIDIA V100).

Switch comparison

vs
NVIDIA

Volta

NVIDIA V100

$0.55/hrCheaper

$0.45-$0.65/hr range · 4 regions

VRAM32GB HBM2
FP1631.4 TFLOPS
Bandwidth900 GB/s
Deploy NVIDIA V100Full pricing details
AMD

CDNA 2

AMD MI250X

$1.35/hr

$1.20-$1.50/hr range · 4 regions

VRAM128GB HBM2e
FP1695.7 TFLOPS
Bandwidth3.3 TB/s
Deploy AMD MI250XFull pricing details

At a glance

Spec by spec.

Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.

VRAM

NVIDIA V100
32 GB
AMD MI250X
128 GB

Memory Bandwidth

NVIDIA V100
900 GB/s
AMD MI250X
3.3 TB/s

FP16 Performance

NVIDIA V100
31.4 TFLOPS
AMD MI250X
95.7 TFLOPS

Hourly Price

NVIDIA V100
$0.55/hr
AMD MI250X
$1.35/hr

Full specs

Complete spec sheet.

SpecNVIDIA V100AMD MI250X
ArchitectureVoltaCDNA 2
VRAM32 GB128 GB
Memory TypeHBM2HBM2e
Memory Bandwidth900 GB/s3.3 TB/s
FP32 Performance15.7 TFLOPS47.9 TFLOPS
FP16 Performance31.4 TFLOPS95.7 TFLOPS
INT8 Performance125 TOPS383 TOPS
TDP300 W560 W
Form FactorPCIeOAM
NVLinkYesNo
Max GPU/Node88
Hourly Price$0.55/hr$1.35/hr

FAQ

Frequently asked.

Pick a GPU and deploy.

Both GPUs available on Runcrate · per-second billing · no commitments

Other comparisons