Skip to content

NVIDIA · Hopper · 2023

NVIDIA H200. 141 GB HBM3e, 989 TFLOPS FP16 tensor.

141 GB of HBM3e on Hopper, for production LLM inference that outgrows 80 GB.

H200 on demand

from$5.13/hr per GPU
Availability
Available now · 6 regions
By region and size
$5.13 to $10.67/hr
Prepaid
1 mo $5.01/hr3 mo $5.01/hr6 mo $4.72/hr12 mo $4.57/hr
Billing
By the second on most GPUs, a few by the minute
8+ GPUs or a month
Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.

The card

141 GB of HBM3e. At 4.8 TB/s.

Memory
141 GB
HBM3e
Bandwidth
4.8 TB/s
Memory to compute
FP16 tensor
989
TFLOPS
Per node
8 GPUs
NVLink, 700 W each

Workloads

What teams run on the H200. Each one opens the launch form, sized.

Full specs

NVIDIA H200 specifications.

Memory

Memory
141 GB
Type
HBM3e
Bandwidth
4.8 TB/s

Compute

FP32
67 TFLOPS
FP16 tensor
989 TFLOPS
INT8
1979 TOPS
CUDA cores
16,896

Power and form

TDP
700 W
Form factor
SXM
Architecture
Hopper
Released
2023

Node

GPUs per node
8
Interconnect
NVLink
Maker
NVIDIA

Alternatives

Alternatives to the H200. Same account, different price and performance.

GPUMemory · FP16 tensorStands outPrice gapFrom
NVIDIA H200This GPU141 GB HBM3e · 989 TFLOPS$5.13/hr
NVIDIA H10080 GB HBM3 · up to 989 TFLOPS-61 GB memory-24%$3.91/hr
NVIDIA GH20096 GB HBM3 · 990 TFLOPS-45 GB memoryNot in stock right now
NVIDIA H200 NVL141 GB HBM3e · 835 TFLOPS-9%$4.67/hr
AMD MI300X192 GB HBM3 · 1307.4 TFLOPS+51 GB memory-5%$4.85/hr

Questions

Renting the H200. What buyers ask first.

Other GPUs

Browse every GPU by architecture.