Skip to content

NVIDIA · Ada Lovelace · 2023

NVIDIA L40S. 48 GB GDDR6, 362 TFLOPS FP16 tensor.

NVIDIA L40S GPU: full specifications, how it compares and live cloud availability.

L40S on demand

from$0.55/hr per GPU

on an 8-GPU machine

Availability
Available now · 6 regions
By region and size
$0.55 to $2.15/hr
Billing
By the second on most GPUs, a few by the minute
8+ GPUs or a month
Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.

The card

48 GB of GDDR6. At 864 GB/s.

Memory
48 GB
GDDR6
Bandwidth
864 GB/s
Memory to compute
FP16 tensor
362
TFLOPS
Per node
4 GPUs
PCIe, 350 W each

Full specs

NVIDIA L40S specifications.

Memory

Memory
48 GB
Type
GDDR6
Bandwidth
864 GB/s

Compute

FP32
91.6 TFLOPS
FP16 tensor
362 TFLOPS
INT8
733 TOPS
Tensor cores
568
CUDA cores
18,176

Power and form

TDP
350 W
Form factor
PCIe
Architecture
Ada Lovelace
Released
2023

Node

GPUs per node
4
Interconnect
PCIe
Maker
NVIDIA

Alternatives

Alternatives to the L40S. Same account, different price and performance.

GPUMemory · FP16 tensorStands outPrice gapFrom
NVIDIA L40SThis GPU48 GB GDDR6 · 362 TFLOPS$0.55/hr
AMD MI250X128 GB HBM2e · 383 TFLOPS+80 GB memoryNot in stock right now
NVIDIA A100 80GB80 GB HBM2e · 312 TFLOPS+32 GB memory+215%$1.73/hr
NVIDIA A100 40GB40 GB HBM2 · 312 TFLOPS+262%$1.99/hr
NVIDIA RTX 509032 GB GDDR7-16 GB memory+31%$0.72/hr

Questions

Renting the L40S. What buyers ask first.

Other GPUs

Browse every GPU by architecture.