NVIDIA

NVIDIA · Ampere · 2020

NVIDIA A100 SXM.

Battle-tested Ampere SXM with NVLink — best-value 80GB datacenter GPU under $1.10/hr.

80 GB
HBM2e
2.0 TB/s
Bandwidth
78
TFLOPS FP16
8× GPU
NVLink
Available now · 9 regions

Cloud rental

$1.05/hr

On-demand · per-second billing

$0.92$1.18/hr range

Or $0.73/hr reserved (30% off)

Pricing across clouds

NVIDIA A100 SXM cloud rental price comparison.

Same GPU, cheapest-first. Prices reflect publicly listed hourly rates for NVIDIA A100 SXM on each provider. Runcrate is the lowest published rate.

RuncrateCheapest
$1.05/hr
RunPod
$1.29/hr
Oracle
$1.50/hr
Lambda
$1.79/hr
Azure
$2.75/hr
GCP
$2.93/hr
AWS
$3.05/hr

Workloads

What you'll actually use this for.

Real workloads sized for the NVIDIA A100 SXM, with concrete performance numbers. Click to deploy preconfigured.

Deploy

One command. NVIDIA A100 SXM in 60 seconds.

Skip the dashboard if you don't need it. SDK, Python, or cURL — copy the snippet, paste your API key, ship.

import Runcrate from "@runcrate/sdk";

const rc = new Runcrate({ apiKey: "rc_live_••••••••••••••••" });

const instance = await rc.instances.create({
  gpu: "a100-sxm",
  region: "auto",
  image: "runcrate/vllm:latest",
});

console.log(`SSH: ssh root@${instance.host}`);

Benchmarks

How NVIDIA A100 SXM stacks up.

Side-by-side specs vs the closest alternatives. Bars are normalized to the highest value in each metric.

FP16

NVIDIA A100 SXM78 TFLOPS
NVIDIA A100 PCIe78 TFLOPS
NVIDIA L40S183 TFLOPS
AMD MI21047.9 TFLOPS

VRAM

NVIDIA A100 SXM80 GB
NVIDIA A100 PCIe80 GB
NVIDIA L40S48 GB
AMD MI21064 GB

Bandwidth

NVIDIA A100 SXM2.0 TB/s
NVIDIA A100 PCIe1.9 TB/s
NVIDIA L40S864 GB/s
AMD MI2101.6 TB/s

Full specs

NVIDIA A100 SXM specifications.

Memory

VRAM80 GB
Memory typeHBM2e
Bandwidth2.0 TB/s

Compute

FP3219.5 TFLOPS
FP1678 TFLOPS
INT8624 TOPS
Tensor cores6,912
CUDA cores6,912

Power & form factor

TDP400 W
Form factorSXM
ArchitectureAmpere
Released2020

Cluster

Max GPUs/node8
InterconnectNVLink
ManufacturerNVIDIA
Available regions9

FAQ

Frequently asked.

Ready when you are

Deploy NVIDIA A100 SXM
in 60 seconds.

Available across 9 regions · per-second billing · no commitments. Ship today.