Skip to content

GPU comparison

NVIDIA A100 80GB vs NVIDIA A100 40GB.

Specs, performance and live cloud availability, side by side. The NVIDIA A100 80GB is cheaper today, from $1.73/hr.

The short answer

Compare another pair

vs
NVIDIA

Ampere

NVIDIA A100 80GB

from$1.73/hrCheaper
Available now · 6 regions
Memory
80 GB HBM2e
FP16 tensor
312 TFLOPS
Bandwidth
up to 2.0 TB/s
Full pricing details
NVIDIA

Ampere

NVIDIA A100 40GB

from$1.99/hr
Available now · 5 regions
Memory
40 GB HBM2
FP16 tensor
312 TFLOPS
Bandwidth
1.6 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA A100 80GB80 GB
NVIDIA A100 40GB40 GB

Memory bandwidth

NVIDIA A100 80GBup to 2.0 TB/s
NVIDIA A100 40GB1.6 TB/s

FP16 tensor

NVIDIA A100 80GB312 TFLOPS
NVIDIA A100 40GB312 TFLOPS

Hourly price, from (live)

NVIDIA A100 80GB$1.73/hr
NVIDIA A100 40GB$1.99/hr

Full specs

The complete spec sheet.

SpecNVIDIA A100 80GBNVIDIA A100 40GB
ArchitectureAmpereAmpere
Memory80 GB40 GB
Memory typeHBM2eHBM2
Memory bandwidthup to 2.0 TB/s1.6 TB/s
FP3219.5 TFLOPS19.5 TFLOPS
FP16 tensor312 TFLOPS312 TFLOPS
INT8624 TOPS624 TOPS
TDPup to 400 Wup to 400 W
GPUs per node88
Hourly price (live)from $1.73/hrfrom $1.99/hr

Questions

A100 80GB or A100 40GB. What buyers ask first.

Other comparisons

More pairs with the NVIDIA A100 80GB.