CoreWeave AI Object Storage Delivers 2+ GB/s per GPU

This post details benchmark results for CoreWeave AI Object Storage (CAIOS) demonstrating read throughput of over 2 GB/s per GPU. It highlights the Local Object Transport Accelerator (LOTA™) feature, which caches data on local NVMe disks within GPU nodes. The benchmark methodology involved deploying a test application on 20 NVIDIA H200 GPU nodes using the Warp S3 benchmarking tool, simulating read and write operations to the cwlota.com endpoint. The results show that after initial cache population, the system achieved an aggregate read throughput of 368 GiB/s, averaging 18.4 GiB/s per node or 2.3 GiB/s per GPU. The post emphasizes that this performance is expected to scale to any number of GPU nodes and GPUs due to its reliance on local storage performance.