MLPerf Results: A Record-Breaking, Cloud-Native AI Supercomputer | CoreWeave

CoreWeave and NVIDIA achieved record-breaking performance on MLPerf Training 3.0, specifically for the GPT-3 175B LLM benchmark, training in under 11 minutes on over 3,500 NVIDIA H100 Tensor Core GPUs. This was accomplished on a production cluster featuring NVIDIA Quantum-2 InfiniBand networking, HGX H100 instances, Intel 4th Generation Xeon Scalable Processors, and NVIDIA ConnectX-7 400Gb/s InfiniBand and BlueField-2 DPUs. The post highlights the scale (over 3,500 GPUs, 4x larger than the next competitor) and speed (29x faster than the next best competitor) achieved, emphasizing CoreWeave's specialized infrastructure for AI workloads and its role as a 'utility provider' for AI compute.