GPU Comparison

NVIDIA L40SvsNVIDIA RTX 4090

Detailed specifications, performance benchmarks, and pricing comparison to help you choose the right GPU for your AI workloads.

NVIDIA

NVIDIA L40S

Ada Lovelace · 2023

Faster
VRAM48 GB GDDR6
FP3291.6 TFLOPS
FP16183 TFLOPS
Bandwidth864 GB/s
TDP350W
Price$0.85/hr
NVIDIA

NVIDIA RTX 4090

Ada Lovelace · 2022

VRAM24 GB GDDR6X
FP3282.6 TFLOPS
FP16165 TFLOPS
Bandwidth1008 GB/s
TDP450W
Price$0.36/hr

Specifications · Comparison

Side by side specs.

SpecNVIDIA L40SNVIDIA RTX 4090
ArchitectureAda LovelaceAda Lovelace
VRAM48 GB+100.0%24 GB
Memory TypeGDDR6GDDR6X
Memory Bandwidth864 GB/s1008 GB/s+14.3%
FP32 Performance91.6 TFLOPS+10.9%82.6 TFLOPS
FP16 Performance183 TFLOPS+10.9%165 TFLOPS
INT8 Performance733 TOPS+10.9%661 TOPS
TDP350W450W
Form FactorPCIeConsumer
Price (avg/hr)$0.85$0.36

Performance · Analysis

Performance breakdown.

Compute (FP32)

Raw single-precision floating point throughput

NVIDIA L40S
91.6TFLOPSWinner
NVIDIA RTX 4090
82.6TFLOPS

NVIDIA L40S is 10.9% faster

Training (FP16)

Half-precision performance for deep learning training

NVIDIA L40S
183TFLOPSWinner
NVIDIA RTX 4090
165TFLOPS

NVIDIA L40S is 10.9% faster

Inference (INT8)

Integer performance for model inference workloads

NVIDIA L40S
733TOPSWinner
NVIDIA RTX 4090
661TOPS

NVIDIA L40S is 10.9% faster

Memory Bandwidth

Data transfer rate between memory and compute units

NVIDIA L40S
864GB/s
NVIDIA RTX 4090
1008GB/sWinner

NVIDIA RTX 4090 is 14.3% faster

Best Compute

NVIDIA L40S

Most Memory

NVIDIA L40S

Best Training

NVIDIA L40S

Best Value

NVIDIA RTX 4090

Pricing · Cost

Cost comparison.

Hourly

NVIDIA L40S
$0.85/hr
NVIDIA RTX 4090
$0.36/hr

Save $0.49 with NVIDIA RTX 4090

Daily

NVIDIA L40S
$20.40/day
NVIDIA RTX 4090
$8.64/day

Save $11.76 with NVIDIA RTX 4090

Monthly

NVIDIA L40S
$612.00/mo
NVIDIA RTX 4090
$259.20/mo

Save $352.80 with NVIDIA RTX 4090

Use Cases · Workloads

Best for your workload.

NVIDIA

NVIDIA L40S

AI Inference
Graphics Rendering
Video Processing
NVIDIA

NVIDIA RTX 4090

AI Development
ML Prototyping
Content Creation
Gaming

Platform · Benefits

Why Runcrate.

Instant Deployment

Get your GPU instance running in minutes with pre-configured AI environments. No setup complexity.

Pay Per Hour

Only pay for the compute you actually use. Prepaid credits with transparent, per-hour billing.

Reliable Infrastructure

Enterprise-grade reliability with automatic failover and data persistence across sessions.

FAQ · Questions

Common questions.

Start Building Today

Deploy NVIDIA L40S or NVIDIA RTX 4090

Get started with GPU cloud computing in minutes. No setup complexity, no long-term commitments.

No credit card required
Pay-per-hour billing
Cancel anytime