NVIDIA · Ada Lovelace · 2023
NVIDIA L40S. 48 GB GDDR6, 362 TFLOPS FP16 tensor.
NVIDIA L40S GPU: full specifications, how it compares and live cloud availability.
L40S on demand
from$0.55/hr per GPU
on an 8-GPU machine
- Availability
- Available now · 6 regions
- By region and size
- $0.55 to $2.15/hr
- Billing
- By the second on most GPUs, a few by the minute
- 8+ GPUs or a month
- Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.
The card
48 GB of GDDR6. At 864 GB/s.
- Memory
- 48 GB
- GDDR6
- Bandwidth
- 864 GB/s
- Memory to compute
- FP16 tensor
- 362
- TFLOPS
- Per node
- 4 GPUs
- PCIe, 350 W each
Full specs
NVIDIA L40S specifications.
Memory
- Memory
- 48 GB
- Type
- GDDR6
- Bandwidth
- 864 GB/s
Compute
- FP32
- 91.6 TFLOPS
- FP16 tensor
- 362 TFLOPS
- INT8
- 733 TOPS
- Tensor cores
- 568
- CUDA cores
- 18,176
Power and form
- TDP
- 350 W
- Form factor
- PCIe
- Architecture
- Ada Lovelace
- Released
- 2023
Node
- GPUs per node
- 4
- Interconnect
- PCIe
- Maker
- NVIDIA
Alternatives
Alternatives to the L40S. Same account, different price and performance.
| GPU | Memory · FP16 tensor | Stands out | Price gap | From |
|---|---|---|---|---|
| NVIDIA L40SThis GPU | 48 GB GDDR6 · 362 TFLOPS | $0.55/hr | ||
| AMD MI250X | 128 GB HBM2e · 383 TFLOPS | +80 GB memory | Not in stock right now | |
| NVIDIA A100 80GB | 80 GB HBM2e · 312 TFLOPS | +32 GB memory | +215% | $1.73/hr |
| NVIDIA A100 40GB | 40 GB HBM2 · 312 TFLOPS | +262% | $1.99/hr | |
| NVIDIA RTX 5090 | 32 GB GDDR7 | -16 GB memory | +31% | $0.72/hr |
Questions
Renting the L40S. What buyers ask first.
Other GPUs
Browse every GPU by architecture.
NVIDIA Blackwell
NVIDIA Hopper
NVIDIA Ampere
NVIDIA Ada Lovelace
NVIDIA Volta