Skip to content

GPU comparison

NVIDIA A100 40GB vs NVIDIA GB200.

Specs, performance and live cloud availability, side by side.

The short answer

  • Choose NVIDIA A100 40GB if you want the Ampere architecture.

  • Choose NVIDIA GB200 if you need 186GB+ on a single GPU (146GB more than NVIDIA A100 40GB).

Compare another pair

vs
NVIDIA

Ampere

NVIDIA A100 40GB

from$1.99/hr
Available now · 5 regions
Memory
40 GB HBM2
FP16 tensor
312 TFLOPS
Bandwidth
1.6 TB/s
Full pricing details
NVIDIA

Blackwell

NVIDIA GB200

Reserved capacity · on request
Memory
186 GB HBM3e
FP16 tensor
2500 TFLOPS
Bandwidth
8.0 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA A100 40GB40 GB
NVIDIA GB200186 GB

Memory bandwidth

NVIDIA A100 40GB1.6 TB/s
NVIDIA GB2008.0 TB/s

FP16 tensor

NVIDIA A100 40GB312 TFLOPS
NVIDIA GB2002500 TFLOPS

FP32

NVIDIA A100 40GB19.5 TFLOPS
NVIDIA GB20090 TFLOPS

Full specs

The complete spec sheet.

SpecNVIDIA A100 40GBNVIDIA GB200
ArchitectureAmpereBlackwell
Memory40 GB186 GB
Memory typeHBM2HBM3e
Memory bandwidth1.6 TB/s8.0 TB/s
FP3219.5 TFLOPS90 TFLOPS
FP16 tensor312 TFLOPS2500 TFLOPS
INT8624 TOPS3600 TOPS
TDPup to 400 W1000 W
GPUs per node88
Hourly price (live)from $1.99/hrReserve on request

Questions

A100 40GB or GB200. What buyers ask first.

Other comparisons

More pairs with the NVIDIA A100 40GB.