GPU Comparison
NVIDIA RTX 3090 vs NVIDIA A40.
Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA RTX 3090 is the cheaper option at $0.22/hr.
TL;DR
Choose NVIDIA A40 if you need 48GB+ on a single GPU (24GB more than NVIDIA RTX 3090).
Choose NVIDIA RTX 3090 if cost is the priority (71% cheaper).
Switch comparison
vs
Ampere
NVIDIA RTX 3090
$0.22/hrCheaper
$0.12-$0.28/hr range · 4 regions
VRAM24GB GDDR6X
FP1671 TFLOPS
Bandwidth936 GB/s
Ampere
NVIDIA A40
$0.75/hr
$0.65-$0.85/hr range · 4 regions
VRAM48GB GDDR6
FP1674.8 TFLOPS
Bandwidth696 GB/s
At a glance
Spec by spec.
Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.
VRAM
NVIDIA RTX 3090
24 GB
NVIDIA A40
48 GB
Memory Bandwidth
NVIDIA RTX 3090
936 GB/s
NVIDIA A40
696 GB/s
FP16 Performance
NVIDIA RTX 3090
71 TFLOPS
NVIDIA A40
74.8 TFLOPS
Hourly Price
NVIDIA RTX 3090
$0.22/hr
NVIDIA A40
$0.75/hr
Full specs
Complete spec sheet.
SpecNVIDIA RTX 3090NVIDIA A40
ArchitectureAmpereAmpere
VRAM24 GB48 GB●
Memory TypeGDDR6XGDDR6
Memory Bandwidth936 GB/s●696 GB/s
FP32 Performance35.6 TFLOPS37.4 TFLOPS●
FP16 Performance71 TFLOPS74.8 TFLOPS●
INT8 Performance284 TOPS299 TOPS●
TDP350 W300 W
Form FactorConsumerPCIe
NVLinkYesNo
Max GPU/Node24
Hourly Price$0.22/hr●$0.75/hr
FAQ
Frequently asked.
Pick a GPU and deploy.
Both GPUs available on Runcrate · per-second billing · no commitments
Other comparisons