> ## Documentation Index
> Fetch the complete documentation index at: https://runcrate.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Available GPUs

> NVIDIA H100, H200, B200, and B300 GPUs for dedicated clusters.

export const RuncrateStyles = () => {
  if (typeof document !== 'undefined' && !document.getElementById('runcrate-overrides')) {
    const s = document.createElement('style');
    s.id = 'runcrate-overrides';
    s.textContent = `
      /* Match Runcrate's rounding scale (--radius: 0.75rem) */
      .rounded-sm { border-radius: 0.5rem !important; }   /* 8px */
      .rounded-md { border-radius: 0.625rem !important; } /* 10px */
      .rounded-lg { border-radius: 0.75rem !important; }  /* 12px */
      .rounded-l-sm { border-top-left-radius: 0.5rem !important; border-bottom-left-radius: 0.5rem !important; }
      .rounded-r-sm { border-top-right-radius: 0.5rem !important; border-bottom-right-radius: 0.5rem !important; }
      .rounded-l-md { border-top-left-radius: 0.625rem !important; border-bottom-left-radius: 0.625rem !important; }
      .rounded-r-md { border-top-right-radius: 0.625rem !important; border-bottom-right-radius: 0.625rem !important; }
      .rounded-l-lg { border-top-left-radius: 0.75rem !important; border-bottom-left-radius: 0.75rem !important; }
      .rounded-r-lg { border-top-right-radius: 0.75rem !important; border-bottom-right-radius: 0.75rem !important; }

      /* Cards: never pure white in light mode */
      .card { background-color: #fcfcfc !important; border-radius: 0.75rem !important; }
      html.dark .card { background-color: #141414 !important; }

      /* Docs hero box */
      .rc-hero { background-color: #fcfcfc; border: 1px solid #e0e0e0; }
      html.dark .rc-hero { background-color: #141414; border-color: #242424; }
      html.dark .rc-hero h1 { color: #f5f5f5; }

      /* Runcrate scrollbar — thin, transparent track, hide-until-hover thumb */
      ::-webkit-scrollbar { width: 6px; height: 6px; background-color: transparent; }
      ::-webkit-scrollbar-track { background-color: transparent; }
      ::-webkit-scrollbar-thumb { background-color: rgba(155, 155, 155, 0.5); border-radius: 10px; transition: opacity 0.3s ease; opacity: 0; }
      ::-webkit-scrollbar-thumb:hover { background-color: rgba(155, 155, 155, 0.7); }
      *:hover::-webkit-scrollbar-thumb,
      *:focus::-webkit-scrollbar-thumb,
      *:active::-webkit-scrollbar-thumb { opacity: 1; }
      * { scrollbar-width: thin; scrollbar-color: rgba(155, 155, 155, 0.5) transparent; }
    `;
    document.head.appendChild(s);
  }
  return null;
};

<RuncrateStyles />

Dedicated clusters are available with the latest NVIDIA data center GPUs, optimized for AI training and inference at scale.

## GPU Options

### NVIDIA H100 SXM

The industry standard for large-scale AI training.

| Spec                 | Value                                                |
| -------------------- | ---------------------------------------------------- |
| **GPU Memory**       | 80 GB HBM3                                           |
| **Memory Bandwidth** | 3.35 TB/s                                            |
| **FP16 Performance** | 989 TFLOPS                                           |
| **Interconnect**     | NVLink 4.0 (900 GB/s)                                |
| **Best For**         | LLM training, fine-tuning, high-throughput inference |

### NVIDIA H200 SXM

Enhanced H100 with more memory and bandwidth for memory-bound workloads.

| Spec                 | Value                                                                    |
| -------------------- | ------------------------------------------------------------------------ |
| **GPU Memory**       | 141 GB HBM3e                                                             |
| **Memory Bandwidth** | 4.8 TB/s                                                                 |
| **FP16 Performance** | 989 TFLOPS                                                               |
| **Interconnect**     | NVLink 4.0 (900 GB/s)                                                    |
| **Best For**         | Large model inference, long-context training, models that need more VRAM |

### NVIDIA B200

Next-generation Blackwell architecture with massive compute gains.

| Spec                 | Value                                                                |
| -------------------- | -------------------------------------------------------------------- |
| **GPU Memory**       | 192 GB HBM3e                                                         |
| **Memory Bandwidth** | 8 TB/s                                                               |
| **FP16 Performance** | 2,250 TFLOPS                                                         |
| **FP4 Performance**  | 9,000 TFLOPS                                                         |
| **Interconnect**     | NVLink 5.0 (1,800 GB/s)                                              |
| **Best For**         | Frontier model training, next-gen inference, FP4 quantized workloads |

### NVIDIA B300

The latest Blackwell Ultra with maximum memory and performance.

| Spec                 | Value                                                                      |
| -------------------- | -------------------------------------------------------------------------- |
| **GPU Memory**       | 288 GB HBM3e                                                               |
| **Memory Bandwidth** | 12 TB/s                                                                    |
| **FP16 Performance** | 2,250 TFLOPS                                                               |
| **FP4 Performance**  | 9,000 TFLOPS                                                               |
| **Interconnect**     | NVLink 5.0 (1,800 GB/s)                                                    |
| **Best For**         | Largest-scale training, trillion-parameter models, maximum memory capacity |

## Choosing a GPU

| GPU      | Memory | Best For                                         | Availability |
| -------- | ------ | ------------------------------------------------ | ------------ |
| **H100** | 80 GB  | General AI training, proven and widely supported | High         |
| **H200** | 141 GB | Memory-hungry models, large batch inference      | Moderate     |
| **B200** | 192 GB | Next-gen training, 2x compute over H100          | Growing      |
| **B300** | 288 GB | Maximum scale, highest memory capacity           | Limited      |

<Tip>
  Not sure which GPU is right for your workload? Contact us at **[support@runcrate.ai](mailto:support@runcrate.ai)** and our team will help you choose the optimal configuration.
</Tip>

## Networking

All dedicated clusters include high-speed interconnect:

| GPU  | Intra-Node (NVLink) | Inter-Node (InfiniBand) |
| ---- | ------------------- | ----------------------- |
| H100 | 900 GB/s            | 400 Gb/s NDR            |
| H200 | 900 GB/s            | 400 Gb/s NDR            |
| B200 | 1,800 GB/s          | 400 Gb/s NDR            |
| B300 | 1,800 GB/s          | 400 Gb/s NDR            |