Skip to content

NVIDIA · Ada Lovelace · 2022

NVIDIA RTX 4090. 24 GB GDDR6X, 165.2 TFLOPS FP16 non-tensor.

An Ada Lovelace card for AI development and fine-tuning, with 24 GB of GDDR6X.

RTX 4090 on demand

from$0.58/hr per GPU

on an 8-GPU machine

Availability
Available now · 3 regions
By region and size
$0.58 to $0.79/hr
Prepaid
1 mo $0.56/hr3 mo $0.54/hr6 mo $0.52/hr12 mo $0.50/hr
Billing
By the second on most GPUs, a few by the minute
8+ GPUs or a month
Launch any size yourself, or prepay a machine for 1 to 12 months at a discount. Custom quotes on request.

The card

24 GB of GDDR6X. At 1.0 TB/s.

Memory
24 GB
GDDR6X
Bandwidth
1.0 TB/s
Memory to compute
FP16
165.2
non-tensor TFLOPS
Per node
2 GPUs
PCIe, 450 W each

Workloads

What teams run on the RTX 4090. Each one opens the launch form, sized.

Full specs

NVIDIA RTX 4090 specifications.

Memory

Memory
24 GB
Type
GDDR6X
Bandwidth
1.0 TB/s

Compute

FP32
82.6 TFLOPS
FP16 non-tensor
165.2 TFLOPS
INT8
661 TOPS
CUDA cores
16,384

Power and form

TDP
450 W
Form factor
Consumer
Architecture
Ada Lovelace
Released
2022

Node

GPUs per node
2
Interconnect
PCIe
Maker
NVIDIA

Alternatives

Alternatives to the RTX 4090. Same account, different price and performance.

GPUMemory · FP16 non-tensorStands outPrice gapFrom
NVIDIA RTX 4090This GPU24 GB GDDR6X · 165.2 TFLOPS$0.58/hr
NVIDIA RTX A600048 GB GDDR6+24 GB memory-2%$0.57/hr
NVIDIA A4048 GB GDDR6+24 GB memory+359%$2.66/hr
AMD MI21064 GB HBM2e+40 GB memoryNot in stock right now
NVIDIA V10032 GB HBM2+8 GB memory+478%$3.35/hr

Questions

Renting the RTX 4090. What buyers ask first.

Other GPUs

Browse every GPU by architecture.