GPU Comparison
NVIDIA L40S vs AMD MI250X.
Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA L40S is the cheaper option at $0.85/hr.
TL;DR
Choose AMD MI250X if you need 128GB+ on a single GPU (80GB more than NVIDIA L40S).
Choose NVIDIA L40S if you need raw FP16 throughput (91% faster than AMD MI250X).
Switch comparison
vs
Ada Lovelace
NVIDIA L40S
$0.85/hrCheaper
$0.78-$0.92/hr range · 4 regions
VRAM48GB GDDR6
FP16183 TFLOPS
Bandwidth864 GB/s
CDNA 2
AMD MI250X
$1.35/hr
$1.20-$1.50/hr range · 4 regions
VRAM128GB HBM2e
FP1695.7 TFLOPS
Bandwidth3.3 TB/s
At a glance
Spec by spec.
Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.
VRAM
NVIDIA L40S
48 GB
AMD MI250X
128 GB
Memory Bandwidth
NVIDIA L40S
864 GB/s
AMD MI250X
3.3 TB/s
FP16 Performance
NVIDIA L40S
183 TFLOPS
AMD MI250X
95.7 TFLOPS
Hourly Price
NVIDIA L40S
$0.85/hr
AMD MI250X
$1.35/hr
Full specs
Complete spec sheet.
SpecNVIDIA L40SAMD MI250X
ArchitectureAda LovelaceCDNA 2
VRAM48 GB128 GB●
Memory TypeGDDR6HBM2e
Memory Bandwidth864 GB/s3.3 TB/s●
FP32 Performance91.6 TFLOPS●47.9 TFLOPS
FP16 Performance183 TFLOPS●95.7 TFLOPS
INT8 Performance733 TOPS●383 TOPS
TDP350 W560 W
Form FactorPCIeOAM
NVLinkNoNo
Max GPU/Node48
Hourly Price$0.85/hr●$1.35/hr
FAQ
Frequently asked.
Pick a GPU and deploy.
Both GPUs available on Runcrate · per-second billing · no commitments
Other comparisons