NVIDIA · Hopper · 2023
NVIDIA H200. 141 GB HBM3e, 989 TFLOPS FP16 tensor.
141 GB of HBM3e on Hopper, for production LLM inference that outgrows 80 GB.
H200 on demand
from$5.13/hr per GPU
- Availability
- Available now · 6 regions
- By region and size
- $5.13 to $10.67/hr
- Prepaid
- 1 mo $5.01/hr3 mo $5.01/hr6 mo $4.72/hr12 mo $4.57/hr
- Billing
- By the second on most GPUs, a few by the minute
- 8+ GPUs or a month
- Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.
The card
141 GB of HBM3e. At 4.8 TB/s.
- Memory
- 141 GB
- HBM3e
- Bandwidth
- 4.8 TB/s
- Memory to compute
- FP16 tensor
- 989
- TFLOPS
- Per node
- 8 GPUs
- NVLink, 700 W each
Workloads
What teams run on the H200. Each one opens the launch form, sized.
Full specs
NVIDIA H200 specifications.
Memory
- Memory
- 141 GB
- Type
- HBM3e
- Bandwidth
- 4.8 TB/s
Compute
- FP32
- 67 TFLOPS
- FP16 tensor
- 989 TFLOPS
- INT8
- 1979 TOPS
- CUDA cores
- 16,896
Power and form
- TDP
- 700 W
- Form factor
- SXM
- Architecture
- Hopper
- Released
- 2023
Node
- GPUs per node
- 8
- Interconnect
- NVLink
- Maker
- NVIDIA
Alternatives
Alternatives to the H200. Same account, different price and performance.
| GPU | Memory · FP16 tensor | Stands out | Price gap | From |
|---|---|---|---|---|
| NVIDIA H200This GPU | 141 GB HBM3e · 989 TFLOPS | $5.13/hr | ||
| NVIDIA H100 | 80 GB HBM3 · up to 989 TFLOPS | -61 GB memory | -24% | $3.91/hr |
| NVIDIA GH200 | 96 GB HBM3 · 990 TFLOPS | -45 GB memory | Not in stock right now | |
| NVIDIA H200 NVL | 141 GB HBM3e · 835 TFLOPS | -9% | $4.67/hr | |
| AMD MI300X | 192 GB HBM3 · 1307.4 TFLOPS | +51 GB memory | -5% | $4.85/hr |
Questions
Renting the H200. What buyers ask first.
Other GPUs
Browse every GPU by architecture.
NVIDIA Blackwell
NVIDIA Ampere
NVIDIA Ada Lovelace
NVIDIA Volta