GPU comparison
B300 vs RTX A6000.
The B300 is ahead on memory (288 GB vs 48 GB) and speed (14.5x the FP16 throughput and up to 10.4x the memory bandwidth). The RTX A6000 makes sense when your model fits in 48 GB and its hourly price is lower.
Rent either on Runcrate
- B300from $10.40/hr
$0.036 per GB/hr$0.46 per 100 TFLOPS/hr
Launch B300 - RTX A6000Cheaperfrom $0.57/hr
$0.012 per GB/hr$0.37 per 100 TFLOPS/hr
Launch RTX A6000
Live hourly price, then per GB of memory and per 100 FP16 TFLOPS.
Which is better for
Which to pick for each job. Memory fit and throughput, from the datasheets.
Hold a 70B model in 8-bit weights
70 GB of 8-bit weights
B300: 1 GPU, 218 GB spare
RTX A6000: 2 GPUs (96 GB)
B300. Fits on one GPU.
Serve an 8B model in 16-bit weights
16 GB of 16-bit weights
B300: 1 GPU, 272 GB spare
RTX A6000: 1 GPU, 32 GB spare
B300. Same GPU count, up to 10.4x the memory bandwidth.
Fine-tune a 70B model with QLoRA
About 46 GB with 4-bit weights
B300: 1 GPU, 242 GB spare
RTX A6000: 1 GPU, 2 GB spare
B300. Same GPU count, 14.5x the FP16 throughput.
Train on a full node
FP16 tensor throughput per node
B300: 8x, 18,000 TFLOPS, NVLink
RTX A6000: 2x, 310 TFLOPS, NVLink
B300. 8 GPUs per node, not 2.
Throughput per watt
FP16 TFLOPS per 100 W of TDP
B300: Varies by card
RTX A6000: 52 TFLOPS per 100 W
Either. Varies by card.
Compare another pair
Blackwell
NVIDIA B300
- Memory
- 288 GB HBM3e
- FP16 tensor
- 2250 TFLOPS
- Bandwidth
- up to 8.0 TB/s
Ampere
NVIDIA RTX A6000
- Memory
- 48 GB GDDR6
- FP16 tensor
- 154.8 TFLOPS
- Bandwidth
- 768 GB/s
At a glance
Spec by spec. The longer bar is the better number.
Full specs
The complete spec sheet.
| Spec | NVIDIA B300 | NVIDIA RTX A6000 |
|---|---|---|
| Architecture | Blackwell | Ampere |
| Memory | 288 GB | 48 GB |
| Memory type | HBM3e | GDDR6 |
| Memory bandwidth | up to 8.0 TB/s | 768 GB/s |
| FP32 | 75 TFLOPS | 38.7 TFLOPS |
| FP16 tensor | 2250 TFLOPS | 154.8 TFLOPS |
| INT8 | 187.5 TOPS | 310 TOPS |
| TDP | up to 1400 W | 300 W |
| Form factor | SXM | PCIe |
| NVLink | Yes | Yes |
| GPUs per node | 8 | 2 |
| Hourly price (live) | from $10.40/hr | from $0.57/hr |
Questions
B300 or RTX A6000. What buyers ask first.
Other comparisons