Comprehensive comparison for AI, machine learning, and high-performance computing workloads.
Hopper Architecture
Ampere Architecture
| Specification | NVIDIA H100 PCIe | NVIDIA RTX A6000 |
|---|---|---|
| Architecture | Hopper | Ampere |
| Release Year | 2022 | 2020 |
| VRAM | 80 GB+66.7% | 48 GB |
| Memory Type | HBM3 | GDDR6 |
| Memory Bandwidth | 2000 GB/s+160.4% | 768 GB/s |
| FP32 Performance | 51 TFLOPS+31.8% | 38.7 TFLOPS |
| FP16 Performance | 102 TFLOPS+31.8% | 77.4 TFLOPS |
| INT8 Performance | 2040 TOPS+558.1% | 310 TOPS |
| Tensor Cores | 14592 | 10752 |
| CUDA Cores | 14592 | 10752 |
| TDP | 350W | 300W |
| Form Factor | PCIe | PCIe |
| NVLink Support | No | Yes |
| Avg. Price/Hour | $1.4+100.0% | $0.7 |
Single-precision floating-point performance for general compute workloads
NVIDIA H100 PCIe is 31.8% faster
Half-precision performance optimized for deep learning training
NVIDIA H100 PCIe is 31.8% faster
Integer performance for efficient model inference and deployment
NVIDIA H100 PCIe is 558.1% faster
Data transfer speed between GPU and memory
NVIDIA H100 PCIe is 160.4% faster
NVIDIA H100 PCIe
NVIDIA H100 PCIe
NVIDIA RTX A6000
NVIDIA H100 PCIe
Enterprise-grade infrastructure
Get a custom quote in 24 hours for reserved GPU clusters with high-speed interconnect, any region, any GPU model, and any number of GPUs you need.
Any GPU
Choose your hardware
Any Quantity
Scale as needed
Any Region
Global availability
Interconnect
High-speed networking
Go from comparison to running workload in under 60 seconds. No complex setup required.
Only pay for what you use. Stop instances anytime. No hidden fees or long-term commitments.
Enterprise-grade infrastructure with 99.9% uptime. Trusted by AI teams worldwide.
Explore more GPU comparisons to find the perfect match for your workload