CoreWeave Sets MLPerf® Training v6.0 Records | CoreWeave Blog

CoreWeave sets new MLPerf® Training v6.0 records for DeepSeek-V3 671B (2.02 minutes with 8,192 NVIDIA GB300 NVL72 GPUs) and Llama-3.1-405B (9.77 minutes with 4,096 Blackwell Ultra GPUs). The post details the infrastructure optimizations that enable efficient scaling across thousands of GPUs, including NVLink-domain-aware scheduling in CKS and SUNK, topology-aware workload placement, and deep networking optimizations using NVIDIA Spectrum-X Ethernet with RoCE. It highlights the importance of system-wide optimization beyond raw compute capacity for real-world performance and economics, and demonstrates consistent scaling efficiency on smaller 64-GPU clusters using NVIDIA HGX B200 with InfiniBand.