Skip to content

GPU comparison

NVIDIA A100 80GB vs NVIDIA RTX A6000.

Specs, performance and live cloud availability, side by side. The NVIDIA RTX A6000 is cheaper today, from $0.65/hr.

The short answer

  • Choose NVIDIA A100 80GB if you need 80GB+ on a single GPU (32GB more than NVIDIA RTX A6000).

  • Choose NVIDIA A100 80GB if you need FP16 tensor throughput (102% faster than NVIDIA RTX A6000).

Compare another pair

vs
NVIDIA

Ampere

NVIDIA A100 80GB

from$1.73/hr
Available now · 6 regions
Memory
80 GB HBM2e
FP16 tensor
312 TFLOPS
Bandwidth
up to 2.0 TB/s
Full pricing details
NVIDIA

Ampere

NVIDIA RTX A6000

from$0.65/hrCheaper
Available now · 5 regions
Memory
48 GB GDDR6
FP16 tensor
154.8 TFLOPS
Bandwidth
768 GB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA A100 80GB80 GB
NVIDIA RTX A600048 GB

Memory bandwidth

NVIDIA A100 80GBup to 2.0 TB/s
NVIDIA RTX A6000768 GB/s

FP16 tensor

NVIDIA A100 80GB312 TFLOPS
NVIDIA RTX A6000154.8 TFLOPS

Hourly price, from (live)

NVIDIA A100 80GB$1.73/hr
NVIDIA RTX A6000$0.65/hr

Full specs

The complete spec sheet.

SpecNVIDIA A100 80GBNVIDIA RTX A6000
ArchitectureAmpereAmpere
Memory80 GB48 GB
Memory typeHBM2eGDDR6
Memory bandwidthup to 2.0 TB/s768 GB/s
FP3219.5 TFLOPS38.7 TFLOPS
FP16 tensor312 TFLOPS154.8 TFLOPS
INT8624 TOPS310 TOPS
TDPup to 400 W300 W
GPUs per node82
Hourly price (live)from $1.73/hrfrom $0.65/hr

Questions

A100 80GB or RTX A6000. What buyers ask first.

Other comparisons

More pairs with the NVIDIA A100 80GB.