GPU Comparison
NVIDIA H100 SXM vs NVIDIA V100.
Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA V100 is the cheaper option at $0.55/hr.
TL;DR
Choose NVIDIA H100 SXM if you need 80GB+ on a single GPU (48GB more than NVIDIA V100).
Choose NVIDIA H100 SXM if you need raw FP16 throughput (282% faster than NVIDIA V100).
Switch comparison
vs
Hopper
NVIDIA H100 SXM
$1.50/hr
$1.35-$1.65/hr range · 8 regions
VRAM80GB HBM3
FP16120 TFLOPS
Bandwidth3.4 TB/s
Volta
NVIDIA V100
$0.55/hrCheaper
$0.45-$0.65/hr range · 4 regions
VRAM32GB HBM2
FP1631.4 TFLOPS
Bandwidth900 GB/s
At a glance
Spec by spec.
Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.
VRAM
NVIDIA H100 SXM
80 GB
NVIDIA V100
32 GB
Memory Bandwidth
NVIDIA H100 SXM
3.4 TB/s
NVIDIA V100
900 GB/s
FP16 Performance
NVIDIA H100 SXM
120 TFLOPS
NVIDIA V100
31.4 TFLOPS
Hourly Price
NVIDIA H100 SXM
$1.50/hr
NVIDIA V100
$0.55/hr
Full specs
Complete spec sheet.
SpecNVIDIA H100 SXMNVIDIA V100
ArchitectureHopperVolta
VRAM80 GB●32 GB
Memory TypeHBM3HBM2
Memory Bandwidth3.4 TB/s●900 GB/s
FP32 Performance60 TFLOPS●15.7 TFLOPS
FP16 Performance120 TFLOPS●31.4 TFLOPS
INT8 Performance2400 TOPS●125 TOPS
TDP700 W300 W
Form FactorSXMPCIe
NVLinkYesYes
Max GPU/Node88
Hourly Price$1.50/hr$0.55/hr●
FAQ
Frequently asked.
Pick a GPU and deploy.
Both GPUs available on Runcrate · per-second billing · no commitments
Other comparisons