GPU Comparison
NVIDIA A40 vs NVIDIA RTX 4080.
Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA RTX 4080 is the cheaper option at $0.35/hr.
TL;DR
Choose NVIDIA A40 if you need 48GB+ on a single GPU (32GB more than NVIDIA RTX 4080).
Choose NVIDIA RTX 4080 if you need raw FP16 throughput (30% faster than NVIDIA A40).
Switch comparison
vs
Ampere
NVIDIA A40
$0.75/hr
$0.65-$0.85/hr range · 4 regions
VRAM48GB GDDR6
FP1674.8 TFLOPS
Bandwidth696 GB/s
Ada Lovelace
NVIDIA RTX 4080
$0.35/hrCheaper
$0.25-$0.45/hr range · 4 regions
VRAM16GB GDDR6X
FP1697.4 TFLOPS
Bandwidth736 GB/s
At a glance
Spec by spec.
Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.
VRAM
NVIDIA A40
48 GB
NVIDIA RTX 4080
16 GB
Memory Bandwidth
NVIDIA A40
696 GB/s
NVIDIA RTX 4080
736 GB/s
FP16 Performance
NVIDIA A40
74.8 TFLOPS
NVIDIA RTX 4080
97.4 TFLOPS
Hourly Price
NVIDIA A40
$0.75/hr
NVIDIA RTX 4080
$0.35/hr
Full specs
Complete spec sheet.
SpecNVIDIA A40NVIDIA RTX 4080
ArchitectureAmpereAda Lovelace
VRAM48 GB●16 GB
Memory TypeGDDR6GDDR6X
Memory Bandwidth696 GB/s736 GB/s●
FP32 Performance37.4 TFLOPS48.7 TFLOPS●
FP16 Performance74.8 TFLOPS97.4 TFLOPS●
INT8 Performance299 TOPS390 TOPS●
TDP300 W320 W
Form FactorPCIeConsumer
NVLinkNoNo
Max GPU/Node42
Hourly Price$0.75/hr$0.35/hr●
FAQ
Frequently asked.
Pick a GPU and deploy.
Both GPUs available on Runcrate · per-second billing · no commitments
Other comparisons