Unlock Exascale Performance on NVIDIA GB200 NVL72 with Slurm Topology-Aware Job Scheduling | NVIDIA Technical Blog

This post details the integration of Slurm's new topology/block plugin (version 23.11) with the NVIDIA GB200 NVL72 system to enable topology-aware job scheduling. It explains how this plugin aligns jobs with NVL72 domain boundaries, minimizing fragmentation and optimizing GPU occupancy. The post also discusses how GB200 NVL72 supports larger job segment sizes (up to 18 nodes) compared to previous systems, benefiting high I/O workloads like MoE training, and provides best practices for segment sizing based on simulation results for maximizing cluster utilization.