GPU Comparison

NVIDIA H100 PCIevsNVIDIA L40S

Comprehensive comparison for AI, machine learning, and high-performance computing workloads.

vs
NVIDIA

NVIDIA H100 PCIe

Hopper Architecture

VRAM80 GB HBM3
FP32 Performance51 TFLOPS
Memory Bandwidth2000 GB/s
TDP350W
Avg. Price/Hour$1.4
Performance Leader
NVIDIA

NVIDIA L40S

Ada Lovelace Architecture

VRAM48 GB GDDR6
FP32 Performance91.6 TFLOPS
Memory Bandwidth864 GB/s
TDP350W
Avg. Price/Hour$0.85

Detailed Specifications

SpecificationNVIDIA H100 PCIeNVIDIA L40S
Architecture
Hopper
Ada Lovelace
Release Year
2022
2023
VRAM
80 GB+66.7%
48 GB
Memory Type
HBM3
GDDR6
Memory Bandwidth
2000 GB/s+131.5%
864 GB/s
FP32 Performance
51 TFLOPS
91.6 TFLOPS+44.3%
FP16 Performance
102 TFLOPS
183 TFLOPS+44.3%
INT8 Performance
2040 TOPS+178.3%
733 TOPS
Tensor Cores
14592
18176
CUDA Cores
14592
18176
TDP
350W
350W
Form Factor
PCIe
PCIe
NVLink Support
No
No
Avg. Price/Hour
$1.4+64.7%
$0.85

Performance Breakdown

Compute Performance

Single-precision floating-point performance for general compute workloads

NVIDIA H100 PCIe
51TFLOPS
NVIDIA L40S
91.6TFLOPS

NVIDIA L40S is 44.3% faster

AI Training Performance

Half-precision performance optimized for deep learning training

NVIDIA H100 PCIe
102TFLOPS
NVIDIA L40S
183TFLOPS

NVIDIA L40S is 44.3% faster

AI Inference Performance

Integer performance for efficient model inference and deployment

NVIDIA H100 PCIe
2040TOPS
NVIDIA L40S
733TOPS

NVIDIA H100 PCIe is 178.3% faster

Memory Bandwidth

Data transfer speed between GPU and memory

NVIDIA H100 PCIe
2000GB/s
NVIDIA L40S
864GB/s

NVIDIA H100 PCIe is 131.5% faster

Performance

NVIDIA L40S

Memory

NVIDIA H100 PCIe

Value

NVIDIA L40S

Efficiency

NVIDIA L40S

Ideal Workloads

NVIDIA

NVIDIA H100 PCIe

Deep Learning Training
AI Inference
Data Analytics
NVIDIA

NVIDIA L40S

AI Inference
Graphics Rendering
Video Processing

Cost Analysis

Hourly Rate

NVIDIA H100 PCIe
$1.40per hour
NVIDIA L40S
$0.85per hour
Savings with NVIDIA L40S$0.55 (39%)

Daily Cost

NVIDIA H100 PCIe
$33.60per day
NVIDIA L40S
$20.40per day
Savings with NVIDIA L40S$13.20 (39%)

Monthly Cost

NVIDIA H100 PCIe
$1022.00per month
NVIDIA L40S
$620.50per month
Savings with NVIDIA L40S$401.50 (39%)

Reserved Clusters

Enterprise-grade infrastructure

24h Quote

Need More? We've Got You Covered

Get a custom quote in 24 hours for reserved GPU clusters with high-speed interconnect, any region, any GPU model, and any number of GPUs you need.

Any GPU

Choose your hardware

Any Quantity

Scale as needed

Any Region

Global availability

Interconnect

High-speed networking

Why Rent GPUs on Runcrate?

Instant Deployment

Go from comparison to running workload in under 60 seconds. No complex setup required.

Pay Per Second

Only pay for what you use. Stop instances anytime. No hidden fees or long-term commitments.

Production Ready

Enterprise-grade infrastructure with 99.9% uptime. Trusted by AI teams worldwide.

Frequently Asked Questions

Compare Other GPUs

Explore more GPU comparisons to find the perfect match for your workload

START BUILDING TODAY

Deploy NVIDIA H100 PCIe or NVIDIA L40S

Choose your GPU and deploy in under 60 seconds. No credit card required to sign up.