Skip to content

GPU comparison

NVIDIA A100 40GB vs NVIDIA GB300.

Specs, performance and live cloud availability, side by side.

The short answer

  • Choose NVIDIA A100 40GB if you want the Ampere architecture.

  • Choose NVIDIA GB300 if you need 288GB+ on a single GPU (248GB more than NVIDIA A100 40GB).

Compare another pair

vs
NVIDIA

Ampere

NVIDIA A100 40GB

from$1.99/hr
Available now · 5 regions
Memory
40 GB HBM2
FP16 tensor
312 TFLOPS
Bandwidth
1.6 TB/s
Full pricing details
NVIDIA

Blackwell

NVIDIA GB300

Reserved capacity · on request
Memory
288 GB HBM3e
FP16 tensor
2500 TFLOPS
Bandwidth
8.0 TB/s
Full pricing details

At a glance

Spec by spec. The longer bar is the better number.

Memory

NVIDIA A100 40GB40 GB
NVIDIA GB300288 GB

Memory bandwidth

NVIDIA A100 40GB1.6 TB/s
NVIDIA GB3008.0 TB/s

FP16 tensor

NVIDIA A100 40GB312 TFLOPS
NVIDIA GB3002500 TFLOPS

FP32

NVIDIA A100 40GB19.5 TFLOPS
NVIDIA GB300120 TFLOPS

Full specs

The complete spec sheet.

SpecNVIDIA A100 40GBNVIDIA GB300
ArchitectureAmpereBlackwell
Memory40 GB288 GB
Memory typeHBM2HBM3e
Memory bandwidth1.6 TB/s8.0 TB/s
FP3219.5 TFLOPS120 TFLOPS
FP16 tensor312 TFLOPS2500 TFLOPS
INT8624 TOPS4800 TOPS
TDPup to 400 W1200 W
GPUs per node88
Hourly price (live)from $1.99/hrReserve on request

Questions

A100 40GB or GB300. What buyers ask first.

Other comparisons

More pairs with the NVIDIA A100 40GB.