Storage Benchmarking: Distributed File Storage | CoreWeave

This post details CoreWeave's distributed file storage system for model training, highlighting its architecture (VAST Data's disaggregated two-tier system with CNodes and DNodes) and performance characteristics. It presents benchmark results using fio, demonstrating sustained 1 GiB/s per GPU throughput and peak read/write rates of 70 GiB/s and 50 GiB/s respectively for simulated AI training workloads. The post emphasizes how this storage solution prevents GPU underutilization by ensuring storage does not create bottlenecks, evidenced by sustained 100% GPU core utilization.