NVIDIA

NVIDIA · Hopper · 2022

NVIDIA H100 SXM.

The workhorse for production AI training and inference — the most-deployed Hopper GPU.

80 GB
HBM3
3.4 TB/s
Bandwidth
120
TFLOPS FP16
8× GPU
NVLink
Available now · 8 regions

Cloud rental

$1.50/hr

On-demand · per-second billing

$1.35$1.65/hr range

Or $1.05/hr reserved (30% off)

Pricing across clouds

NVIDIA H100 SXM cloud rental price comparison.

Same GPU, cheapest-first. Prices reflect publicly listed hourly rates for NVIDIA H100 SXM on each provider. Runcrate is the lowest published rate.

RuncrateCheapest
$1.50/hr
RunPod
$1.99/hr
Oracle
$2.40/hr
Lambda
$2.49/hr
GCP
$3.67/hr
Azure
$3.96/hr
AWS
$4.10/hr

Workloads

What you'll actually use this for.

Real workloads sized for the NVIDIA H100 SXM, with concrete performance numbers. Click to deploy preconfigured.

Deploy

One command. NVIDIA H100 SXM in 60 seconds.

Skip the dashboard if you don't need it. SDK, Python, or cURL — copy the snippet, paste your API key, ship.

import Runcrate from "@runcrate/sdk";

const rc = new Runcrate({ apiKey: "rc_live_••••••••••••••••" });

const instance = await rc.instances.create({
  gpu: "h100-sxm",
  region: "auto",
  image: "runcrate/vllm:latest",
});

console.log(`SSH: ssh root@${instance.host}`);

Benchmarks

How NVIDIA H100 SXM stacks up.

Side-by-side specs vs the closest alternatives. Bars are normalized to the highest value in each metric.

FP16

NVIDIA H100 SXM120 TFLOPS
NVIDIA H100 PCIe102 TFLOPS
AMD MI250X95.7 TFLOPS
NVIDIA A100 SXM78 TFLOPS

VRAM

NVIDIA H100 SXM80 GB
NVIDIA H100 PCIe80 GB
AMD MI250X128 GB
NVIDIA A100 SXM80 GB

Bandwidth

NVIDIA H100 SXM3.4 TB/s
NVIDIA H100 PCIe2.0 TB/s
AMD MI250X3.3 TB/s
NVIDIA A100 SXM2.0 TB/s

Full specs

NVIDIA H100 SXM specifications.

Memory

VRAM80 GB
Memory typeHBM3
Bandwidth3.4 TB/s

Compute

FP3260 TFLOPS
FP16120 TFLOPS
INT82400 TOPS
Tensor cores16,896
CUDA cores16,896

Power & form factor

TDP700 W
Form factorSXM
ArchitectureHopper
Released2022

Cluster

Max GPUs/node8
InterconnectNVLink
ManufacturerNVIDIA
Available regions8

FAQ

Frequently asked.

Ready when you are

Deploy NVIDIA H100 SXM
in 60 seconds.

Available across 8 regions · per-second billing · no commitments. Ship today.