Skip to content

GPU comparison

L40S vs RTX 5090.

Pick the L40S for memory: 48 GB vs 32 GB. A QLoRA fine-tune of a 70B model (about 46 GB) fits on one L40S, not on one RTX 5090. The RTX 5090 has 2.1x the memory bandwidth. For models under 32 GB pick by price.

Rent either on Runcrate

Live hourly price, then per GB of memory.

Which is better for

Which to pick for each job. Memory fit, from the datasheets.

  • Hold a 70B model in 8-bit weights

    70 GB of 8-bit weights

    L40S: 2 GPUs (96 GB)

    RTX 5090: 3 GPUs, more than one 2x node

    L40S. Fits in one node (2 GPUs).

  • Serve an 8B model in 16-bit weights

    16 GB of 16-bit weights

    L40S: 1 GPU, 32 GB spare

    RTX 5090: 1 GPU, 16 GB spare

    RTX 5090. Same GPU count, 2.1x the memory bandwidth.

  • Fine-tune a 70B model with QLoRA

    About 46 GB with 4-bit weights

    L40S: 1 GPU, 2 GB spare

    RTX 5090: 2 GPUs (64 GB)

    L40S. Fits on one GPU.

Compare another pair

vs

Ada Lovelace

NVIDIA L40S

from$1.26/hr
Available now · 6 regions
Memory
48 GB GDDR6
Bandwidth
864 GB/s
Full pricing details

Blackwell

NVIDIA RTX 5090

from$0.72/hr per GPUCheaper

on an 8-GPU machine

Available now · 4 regions
Memory
32 GB GDDR7
Bandwidth
1.8 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA L40S48 GB
NVIDIA RTX 509032 GB

Memory bandwidth

NVIDIA L40S864 GB/s
NVIDIA RTX 50901.8 TB/s

FP32

NVIDIA L40S91.6 TFLOPS
NVIDIA RTX 5090104.8 TFLOPS

Hourly price, from (live)

NVIDIA L40S$1.26/hr
NVIDIA RTX 5090$0.72/hr

Full specs

The complete spec sheet.

SpecNVIDIA L40SNVIDIA RTX 5090
ArchitectureAda LovelaceBlackwell
Memory48 GB32 GB
Memory typeGDDR6GDDR7
Memory bandwidth864 GB/s1.8 TB/s
FP3291.6 TFLOPS104.8 TFLOPS
FP16362 TFLOPS, tensor209.5 TFLOPS, non-tensor
INT8733 TOPS838 TOPS
TDP350 W575 W
Form factorPCIeConsumer
NVLinkNoNo
GPUs per node42
Hourly price (live)from $1.26/hrfrom $0.72/hr per GPU on an 8-GPU machine

Questions

L40S or RTX 5090. What buyers ask first.

Other comparisons

More pairs with the L40S or the RTX 5090.