Topology-Aware Workload Scheduling with NVIDIA Topograph | NVIDIA Technical Blog

This post introduces NVIDIA Topograph, an open-source toolkit that discovers cluster topology from cloud APIs or on-premises fabric systems and normalizes it into a common model. It publishes this topology data in formats usable by workload managers like Kubernetes (node labels, NFD resources), Slurm (topology configuration), and Slinky (ConfigMaps). Topograph's architecture includes an API Server, Node Observer, Node Data Broker, Providers (e.g., for InfiniBand, Spectrum-X, cloud APIs), and Engines. It addresses the challenge of keeping scheduler topology views current by regenerating them on request and upon watched cluster changes. The post details deployment options and integration with schedulers like KAI Scheduler for topology-aware gang scheduling.