Skip to content

NVIDIA · Ampere · 2020

NVIDIA A40. 48 GB GDDR6, 149.7 TFLOPS FP16 tensor.

NVIDIA A40 Datacenter GPU: full specifications, how it compares and live cloud availability.

A40 on demand

from$2.66/hr per GPU
Availability
Available now · 2 regions
Prepaid
1 mo $2.53/hr3 mo $2.45/hr6 mo $2.37/hr12 mo $2.27/hr
Billing
By the second on most GPUs, a few by the minute
8+ GPUs or a month
Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.

The card

48 GB of GDDR6. At 696 GB/s.

Memory
48 GB
GDDR6
Bandwidth
696 GB/s
Memory to compute
FP16 tensor
149.7
TFLOPS
Per node
4 GPUs
PCIe, 300 W each

Full specs

NVIDIA A40 specifications.

Memory

Memory
48 GB
Type
GDDR6
Bandwidth
696 GB/s

Compute

FP32
37.4 TFLOPS
FP16 tensor
149.7 TFLOPS
INT8
299 TOPS
Tensor cores
336
CUDA cores
10,752

Power and form

TDP
300 W
Form factor
PCIe
Architecture
Ampere
Released
2020

Node

GPUs per node
4
Interconnect
PCIe
Maker
NVIDIA

Alternatives

Alternatives to the A40. Same account, different price and performance.

GPUMemory · FP16 tensorStands outPrice gapFrom
NVIDIA A40This GPU48 GB GDDR6 · 149.7 TFLOPS$2.66/hr
NVIDIA RTX A600048 GB GDDR6 · 154.8 TFLOPS-79%$0.57/hr
NVIDIA RTX 409024 GB GDDR6X-24 GB memory-78%$0.58/hr
NVIDIA V10032 GB HBM2 · 125 TFLOPS-16 GB memory+26%$3.35/hr
AMD MI21064 GB HBM2e · 181 TFLOPS+16 GB memoryNot in stock right now

Questions

Renting the A40. What buyers ask first.

Other GPUs

Browse every GPU by architecture.