NVIDIA · Ampere · 2020
NVIDIA A40. 48 GB GDDR6, 149.7 TFLOPS FP16 tensor.
NVIDIA A40 Datacenter GPU: full specifications, how it compares and live cloud availability.
A40 on demand
from$2.66/hr per GPU
- Availability
- Available now · 2 regions
- Prepaid
- 1 mo $2.53/hr3 mo $2.45/hr6 mo $2.37/hr12 mo $2.27/hr
- Billing
- By the second on most GPUs, a few by the minute
- 8+ GPUs or a month
- Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.
The card
48 GB of GDDR6. At 696 GB/s.
- Memory
- 48 GB
- GDDR6
- Bandwidth
- 696 GB/s
- Memory to compute
- FP16 tensor
- 149.7
- TFLOPS
- Per node
- 4 GPUs
- PCIe, 300 W each
Full specs
NVIDIA A40 specifications.
Memory
- Memory
- 48 GB
- Type
- GDDR6
- Bandwidth
- 696 GB/s
Compute
- FP32
- 37.4 TFLOPS
- FP16 tensor
- 149.7 TFLOPS
- INT8
- 299 TOPS
- Tensor cores
- 336
- CUDA cores
- 10,752
Power and form
- TDP
- 300 W
- Form factor
- PCIe
- Architecture
- Ampere
- Released
- 2020
Node
- GPUs per node
- 4
- Interconnect
- PCIe
- Maker
- NVIDIA
Alternatives
Alternatives to the A40. Same account, different price and performance.
| GPU | Memory · FP16 tensor | Stands out | Price gap | From |
|---|---|---|---|---|
| NVIDIA A40This GPU | 48 GB GDDR6 · 149.7 TFLOPS | $2.66/hr | ||
| NVIDIA RTX A6000 | 48 GB GDDR6 · 154.8 TFLOPS | -79% | $0.57/hr | |
| NVIDIA RTX 4090 | 24 GB GDDR6X | -24 GB memory | -78% | $0.58/hr |
| NVIDIA V100 | 32 GB HBM2 · 125 TFLOPS | -16 GB memory | +26% | $3.35/hr |
| AMD MI210 | 64 GB HBM2e · 181 TFLOPS | +16 GB memory | Not in stock right now |
Questions
Renting the A40. What buyers ask first.
Other GPUs
Browse every GPU by architecture.
NVIDIA Blackwell
NVIDIA Hopper
NVIDIA Ampere
NVIDIA Ada Lovelace
NVIDIA Volta