GPU Comparison

NVIDIA A100 SXM vs NVIDIA RTX A6000.

Side-by-side comparison of specs, performance, and cloud rental pricing. NVIDIA RTX A6000 is the cheaper option at $0.70/hr.

TL;DR

Choose NVIDIA A100 SXM if you need 80GB+ on a single GPU (32GB more than NVIDIA RTX A6000).

Choose NVIDIA RTX A6000 if cost is the priority (33% cheaper).

Switch comparison

vs
NVIDIA

Ampere

NVIDIA A100 SXM

$1.05/hr

$0.92-$1.18/hr range · 9 regions

VRAM80GB HBM2e
FP1678 TFLOPS
Bandwidth2.0 TB/s
Deploy NVIDIA A100 SXMFull pricing details
NVIDIA

Ampere

NVIDIA RTX A6000

$0.70/hrCheaper

$0.60-$0.80/hr range · 4 regions

VRAM48GB GDDR6
FP1677.4 TFLOPS
Bandwidth768 GB/s
Deploy NVIDIA RTX A6000Full pricing details

At a glance

Spec by spec.

Visual comparison across the four specs that matter most for AI workloads. Green bar marks the winner.

VRAM

NVIDIA A100 SXM
80 GB
NVIDIA RTX A6000
48 GB

Memory Bandwidth

NVIDIA A100 SXM
2.0 TB/s
NVIDIA RTX A6000
768 GB/s

FP16 Performance

NVIDIA A100 SXM
78 TFLOPS
NVIDIA RTX A6000
77.4 TFLOPS

Hourly Price

NVIDIA A100 SXM
$1.05/hr
NVIDIA RTX A6000
$0.70/hr

Full specs

Complete spec sheet.

SpecNVIDIA A100 SXMNVIDIA RTX A6000
ArchitectureAmpereAmpere
VRAM80 GB48 GB
Memory TypeHBM2eGDDR6
Memory Bandwidth2.0 TB/s768 GB/s
FP32 Performance19.5 TFLOPS38.7 TFLOPS
FP16 Performance78 TFLOPS77.4 TFLOPS
INT8 Performance624 TOPS310 TOPS
TDP400 W300 W
Form FactorSXMPCIe
NVLinkYesYes
Max GPU/Node82
Hourly Price$1.05/hr$0.70/hr

FAQ

Frequently asked.

Pick a GPU and deploy.

Both GPUs available on Runcrate · per-second billing · no commitments

Other comparisons