CoreWeave, NVIDIA, and IBM Set MLPerf Record with Largest NVIDIA GB200 Blackwell Cluster, Achieving Over 2× Faster Training

This post details CoreWeave's record-breaking MLPerf Training v5.0 submission using 2,496 NVIDIA Blackwell GPUs, achieving over 2x faster training performance than NVIDIA Hopper-based systems. It highlights the largest NVIDIA Blackwell cluster submission to date and the fastest training results on the Llama 3.1 405B benchmark. The post quantifies infrastructure density improvements with GB200 NVL72, showing a 4x reduction in physical space. It also references previous MLPerf records for inference and training, emphasizing CoreWeave's AI-optimized infrastructure and its ability to deliver scale, speed, and efficiency for AI workloads through its CKS and SUNK solutions.