Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions triton/ref/gpu.rst
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
:class: scicomp-table-dense

GPU brand name | GPU name in Slurm (``--gpus=NAME:n``) | VRAM GB (``--gres=gpu-vram:NNg``) | CUDA compute capability (``--gres=min-cuda-cc=NN``) | total amount | nodes | GPUs per node | Compute threads per GPU | Slurm partition (``--partition=``) |
NVIDIA B300(*) | ``b300`` | ``288`` | 10.3 (``103``) | 16 | gpu[64-65] | 8 | 18944 | ``gpu-b300-288g-ellis``, ``gpu-b300-288g-short`` |
NVIDIA H200(*) | ``h200`` | ``141`` | 9.0 (``90``) | 112 | gpu[50-63] | 8 | 16896 | ``gpu-h200-141g-ellis``, ``gpu-h200-141g-short`` |
NVIDIA H200(**) | ``h200_2g.35gb`` | ``35`` | 9.0 (``90``) | 24 | gpu[49] | 24 | 4224 | ``gpu-h200-35g-ia-ellis``, ``gpu-h200-35g-ia`` |
NVIDIA H100 | ``h100`` | ``80`` | 9.0 (``90``) | 16 | gpu[45-48] | 4 | 16896 | ``gpu-h100-80g`` |
Expand Down
1 change: 1 addition & 0 deletions triton/ref/hardware.rst
Original file line number Diff line number Diff line change
Expand Up @@ -20,3 +20,4 @@
gpu[45-48] | 4 | Dell PowerEdge XE8640 | 2024 | saphr avx2 h100 hopper | 2x48 core `Xeon Platinum 8468 <https://www.intel.com/content/www/us/en/products/sku/231735/intel-xeon-platinum-8468-processor-105m-cache-2-10-ghz/specifications.html>`__ 2.1GHz | 1024GB DDR5-4800 | HDR | 4x `H100 SXM <https://www.nvidia.com/en-us/data-center/h100/>`__ 80GB | 21 TB SSD
gpu[49] | 1 | Dell PowerEdge XE9680 | 2025 | emerald avx2 h200 hopper | 2x32 core `Xeon® Platinum 8562Y+ <https://www.intel.com/content/www/us/en/products/sku/237558/intel-xeon-platinum-8562y-processor-60m-cache-2-80-ghz/specifications.html>`__ 2.8GHz | 2048GB DDR5-5600 | HDR | 8x `H200 SXM <https://www.nvidia.com/en-us/data-center/h200/>`__ each split to 3x35GB | 20 TB SSD
gpu[50-63] | 14 | Dell PowerEdge XE9680 | 2025 | emerald avx2 h200 hopper | 2x32 core `Xeon® Platinum 8562Y+ <https://www.intel.com/content/www/us/en/products/sku/237558/intel-xeon-platinum-8562y-processor-60m-cache-2-80-ghz/specifications.html>`__ 2.8GHz | 2048GB DDR5-5600 | HDR | 8x `H200 SXM <https://www.nvidia.com/en-us/data-center/h200/>`__ 141GB | 20 TB SSD
gpu[64-65] | 2 | Dell PowerEdge XE9780 | 2026 | granite avx2 b300 blackwell | 2x64 core `Xeon® 6767P <https://www.intel.com/content/www/us/en/products/sku/241845/intel-xeon-6767p-processor-336m-cache-2-40-ghz/specifications.html>`__ 2.4GHz | 3072GB DDR5-6400 | NDR | 8x `B300 SXM6 AC <https://www.nvidia.com/en-us/data-center/technologies/blackwell-architecture/>`__ 288GB | 28 TB SSD