NVIDIA

NVIDIA · Hopper · 2022

NVIDIA H100 SXM.

The workhorse for production AI training and inference — the most-deployed Hopper GPU.

Available now · 8 regions
From $1.35/hr

Memory

80 GB

HBM3

Bandwidth

3.4 TB/s

Memory I/O

FP16

120

TFLOPS

TDP

700 W

Hopper

Workloads

What you'll actually use this for.

Real workloads sized for the NVIDIA H100 SXM, with concrete performance numbers. Click to deploy preconfigured.

Specs

Full specifications.

GPU Memory80 GB HBM3
Memory Bandwidth3350 GB/s
FP32 Performance60 TFLOPS
FP16 Performance120 TFLOPS
INT8 Performance2400 TOPS
Tensor Cores16,896
CUDA Cores16,896
TDP700 W
ArchitectureHopper
Form FactorSXM
NVLinkYes
Max GPUs per Node8
Release Year2022

FAQ

Frequently asked.

Rent the NVIDIA H100 SXM on Runcrate.

Available now · 8 regions · per-second billing · from $1.35/hr

Other GPUs