NVIDIA H100 vs NVIDIA L40S: which is better for AI?

Choose NVIDIA H100 if you need 80GB+ on a single GPU (32GB more than NVIDIA L40S). Choose NVIDIA H100 if you need FP16 tensor throughput (173% faster than NVIDIA L40S).

What's the price difference between NVIDIA H100 and NVIDIA L40S?

On Runcrate today, NVIDIA H100 starts at $4.29/hr and NVIDIA L40S starts at $1.14/hr; NVIDIA L40S is cheaper by 73%.

Can I deploy NVIDIA H100 or NVIDIA L40S on Runcrate today?

NVIDIA H100 is on demand in 4 regions from $4.29/hr, billed by the second on most GPUs. NVIDIA L40S is on demand in 3 regions from $1.14/hr, billed by the second on most GPUs.

How much VRAM does each GPU have?

NVIDIA H100 has 80GB HBM3. NVIDIA L40S has 48GB GDDR6.

GPU comparison

NVIDIA H100 vs NVIDIA L40S.

Specs, performance and live cloud availability, side by side. The NVIDIA L40S is cheaper today, from $1.14/hr.

Launch L40S Get a reserved quote

The short answer

Choose NVIDIA H100 if you need 80GB+ on a single GPU (32GB more than NVIDIA L40S).
Choose NVIDIA H100 if you need FP16 tensor throughput (173% faster than NVIDIA L40S).

Compare another pair

Hopper

NVIDIA H100

from$4.29/hr

Available now · 4 regions

Memory: 80 GB HBM3
FP16 tensor: up to 989 TFLOPS
Bandwidth: up to 3.4 TB/s

Launch H100 Get a reserved quote

Full pricing details

Ada Lovelace

NVIDIA L40S

from$1.14/hrCheaper

Available now · 3 regions

Memory: 48 GB GDDR6
FP16 tensor: 362 TFLOPS
Bandwidth: 864 GB/s

Launch L40S Get a reserved quote

Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA H10080 GB

NVIDIA L40S48 GB

Memory bandwidth

NVIDIA H100up to 3.4 TB/s

NVIDIA L40S864 GB/s

FP16 tensor

NVIDIA H100up to 989 TFLOPS

NVIDIA L40S362 TFLOPS

Hourly price, from (live)

NVIDIA H100$4.29/hr

NVIDIA L40S$1.14/hr

Full specs

The complete spec sheet.

Spec	NVIDIA H100	NVIDIA L40S
Architecture	Hopper	Ada Lovelace
Memory	80 GB	48 GB
Memory type	HBM3	GDDR6
Memory bandwidth	up to 3.4 TB/s	864 GB/s
FP32	up to 67 TFLOPS	91.6 TFLOPS
FP16 tensor	up to 989 TFLOPS	362 TFLOPS
INT8	up to 2400 TOPS	733 TOPS
TDP	up to 700 W	350 W
GPUs per node	8	4
Hourly price (live)	from $4.29/hr	from $1.14/hr

Questions

H100 or L40S. What buyers ask first.