GPU comparison
NVIDIA H200 vs NVIDIA A100 40GB.
Specs, performance and live cloud availability, side by side. The NVIDIA A100 40GB is cheaper today, from $1.99/hr.
The short answer
Choose NVIDIA H200 if you need 141GB+ on a single GPU (101GB more than NVIDIA A100 40GB).
Choose NVIDIA H200 if you need FP16 tensor throughput (217% faster than NVIDIA A100 40GB).
Compare another pair
vs
Hopper
NVIDIA H200
from$4.63/hr
Available now · 3 regions- Memory
- 141 GB HBM3e
- FP16 tensor
- 989 TFLOPS
- Bandwidth
- 4.8 TB/s
Ampere
NVIDIA A100 40GB
from$1.99/hrCheaper
Available now · 5 regions- Memory
- 40 GB HBM2
- FP16 tensor
- 312 TFLOPS
- Bandwidth
- 1.6 TB/s
At a glance
Spec by spec. The longer bar is the better number.
Full specs
The complete spec sheet.
| Spec | NVIDIA H200 | NVIDIA A100 40GB |
|---|---|---|
| Architecture | Hopper | Ampere |
| Memory | 141 GB | 40 GB |
| Memory type | HBM3e | HBM2 |
| Memory bandwidth | 4.8 TB/s | 1.6 TB/s |
| FP32 | 67 TFLOPS | 19.5 TFLOPS |
| FP16 tensor | 989 TFLOPS | 312 TFLOPS |
| INT8 | 2680 TOPS | 624 TOPS |
| TDP | 700 W | up to 400 W |
| GPUs per node | 8 | 8 |
| Hourly price (live) | from $4.63/hr | from $1.99/hr |
Questions
H200 or A100 40GB. What buyers ask first.
Other comparisons