The Power of the NVIDIA GB200 NVL72 | CoreWeave

This post details the live demonstration and performance evaluation of the NVIDIA GB200 NVL72 on CoreWeave's platform. It showcases NCCL Allreduce and GPUBlaze tests to highlight the interconnectivity and computational power of the 72 GPUs. The post also describes a Megatron training run using CoreWeave's CKS and SUNK, demonstrating distributed workload efficiency and the use of CoreWeave Observability Services for monitoring GPU utilization, memory, power consumption, and temperature. It further mentions the integration with NVIDIA Quantum-2 InfiniBand networking and its SHARP In-Network Computing technology.