Question 1

How much does it cost to rent an H200 GPU per hour?

Accepted Answer

Runcrate H200 pricing starts at $2.10/hr on-demand, with an average of $2.25/hr. With a reserved commitment, the rate drops 30% to $1.58/hr. Lambda lists $2.99, AWS $3.85, GCP $4.20 — Runcrate is consistently the lowest published H200 cloud rate.

Question 2

What's the H200 rental price compared to H100?

Accepted Answer

H200 is ~50% more expensive than H100 SXM ($2.25 vs $1.50/hr) but offers 76% more VRAM (141GB vs 80GB) and 43% more memory bandwidth. For models that overflow H100's 80GB, H200 is cheaper than running 2x H100s.

Question 3

Is the H200 available to rent on demand?

Accepted Answer

Yes. H200 is available on demand across 6 regions on Runcrate. Deploy in under 60 seconds, billed per second.

Question 4

Can I run Llama 405B on an H200?

Accepted Answer

Not on a single H200 (141GB is below the 405B requirement in bf16). For Llama 405B you'll want a B200 (192GB) or a multi-H200 setup. Llama 70B and Mistral Large 2 fit comfortably on one H200.

Question 5

How does H200 compare to RTX 5090 for AI workloads?

Accepted Answer

H200 has 4.4x more VRAM (141GB vs 32GB) and is built for production serving with NVLink, ECC memory, and 8-GPU node scaling. RTX 5090 is a development/gaming card — fine for prototyping under 32GB models, not for production.

NVIDIA H200.

What you'll actually use this for.

Llama 70B Inference

Mistral Large 2 Serving

Fine-tune Qwen 72B

Stable Diffusion Batch

Full specifications.

Other Hopper GPUs.

Frequently asked.

Rent the NVIDIA H200 on Runcrate.