Skip to content

GPU comparison

B200 vs RTX 5090.

Pick the B200 for memory: 180 GB vs 32 GB, with 4.5x the memory bandwidth. A 70B model in 8-bit weights (70 GB) fits on one B200, not on one RTX 5090. For models under 32 GB pick by price.

Rent either on Runcrate

Live hourly price, then per GB of memory.

Which is better for

Which to pick for each job. Memory fit, from the datasheets.

  • Hold a 70B model in 8-bit weights

    70 GB of 8-bit weights

    B200: 1 GPU, 110 GB spare

    RTX 5090: 3 GPUs, more than one 2x node

    B200. Fits on one GPU.

  • Serve an 8B model in 16-bit weights

    16 GB of 16-bit weights

    B200: 1 GPU, 164 GB spare

    RTX 5090: 1 GPU, 16 GB spare

    B200. Same GPU count, 4.5x the memory bandwidth.

  • Fine-tune a 70B model with QLoRA

    About 46 GB with 4-bit weights

    B200: 1 GPU, 134 GB spare

    RTX 5090: 2 GPUs (64 GB)

    B200. Fits on one GPU.

Compare another pair

vs

Blackwell

NVIDIA B200

from$9.59/hr
Available now · 1 region
Memory
180 GB HBM3e
Bandwidth
8.0 TB/s
Full pricing details

Blackwell

NVIDIA RTX 5090

from$0.72/hr per GPUCheaper

on an 8-GPU machine

Available now · 4 regions
Memory
32 GB GDDR7
Bandwidth
1.8 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA B200180 GB
NVIDIA RTX 509032 GB

Memory bandwidth

NVIDIA B2008.0 TB/s
NVIDIA RTX 50901.8 TB/s

FP32

NVIDIA B20075 TFLOPS
NVIDIA RTX 5090104.8 TFLOPS

Hourly price, from (live)

NVIDIA B200$9.59/hr
NVIDIA RTX 5090$0.72/hr

Full specs

The complete spec sheet.

SpecNVIDIA B200NVIDIA RTX 5090
ArchitectureBlackwellBlackwell
Memory180 GB32 GB
Memory typeHBM3eGDDR7
Memory bandwidth8.0 TB/s1.8 TB/s
FP3275 TFLOPS104.8 TFLOPS
FP162250 TFLOPS, tensor209.5 TFLOPS, non-tensor
INT84500 TOPS838 TOPS
TDP1000 W575 W
Form factorSXMConsumer
NVLinkYesNo
GPUs per node82
Hourly price (live)from $9.59/hrfrom $0.72/hr per GPU on an 8-GPU machine

Questions

B200 or RTX 5090. What buyers ask first.

Other comparisons

More pairs with the B200 or the RTX 5090.