A Deep Dive on CoreWeave Innovations | CoreWeave Blog

This post details the engineering innovations behind CoreWeave's deployment of NVIDIA Vera Rubin NVL72, focusing on rack-scale AI infrastructure. Key contributions include the patent-pending Valvey system for software-defined liquid cooling with per-rack isolation, Racky for unified rack management and sensor aggregation, and the integration of liquid-cooled NVIDIA Spectrum-X SN6600 Ethernet switches to achieve 1.64 Pb/s per rack bandwidth. It also discusses the choice of multi-rail, multi-plane networking (InfiniBand and RoCE) with ConnectX-9 SuperNICs for large-scale training and inference clusters, and the overall software stack engineering to maximize FLOPs utilization.