GPU Comparison
NVIDIA A40 vs NVIDIA RTX A6000.
Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA RTX A6000 is the cheaper option at $0.70/hr.
TL;DR
Choose NVIDIA A40 if you want the Ampere architecture or PCIe form factor.
Choose NVIDIA RTX A6000 if you want the Ampere architecture or PCIe form factor.
Switch comparison
vs
Ampere
NVIDIA A40
$0.75/hr
$0.65-$0.85/hr range · 4 regions
VRAM48GB GDDR6
FP1674.8 TFLOPS
Bandwidth696 GB/s
Ampere
NVIDIA RTX A6000
$0.70/hrCheaper
$0.60-$0.80/hr range · 4 regions
VRAM48GB GDDR6
FP1677.4 TFLOPS
Bandwidth768 GB/s
At a glance
Spec by spec.
Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.
VRAM
NVIDIA A40
48 GB
NVIDIA RTX A6000
48 GB
Memory Bandwidth
NVIDIA A40
696 GB/s
NVIDIA RTX A6000
768 GB/s
FP16 Performance
NVIDIA A40
74.8 TFLOPS
NVIDIA RTX A6000
77.4 TFLOPS
Hourly Price
NVIDIA A40
$0.75/hr
NVIDIA RTX A6000
$0.70/hr
Full specs
Complete spec sheet.
SpecNVIDIA A40NVIDIA RTX A6000
ArchitectureAmpereAmpere
VRAM48 GB●48 GB
Memory TypeGDDR6GDDR6
Memory Bandwidth696 GB/s768 GB/s●
FP32 Performance37.4 TFLOPS38.7 TFLOPS●
FP16 Performance74.8 TFLOPS77.4 TFLOPS●
INT8 Performance299 TOPS310 TOPS●
TDP300 W300 W
Form FactorPCIePCIe
NVLinkNoYes
Max GPU/Node42
Hourly Price$0.75/hr$0.70/hr●
FAQ
Frequently asked.
Pick a GPU and deploy.
Both GPUs available on Runcrate · per-second billing · no commitments
Other comparisons