CoreWeave Achieves New Record-Breaking AI Inferencing Benchmark with NVIDIA GB200 Grace Blackwell Superchips
Apr 2, 2025
Summary
CoreWeave submitted MLPerf v5.0 Inference Closed results for NVIDIA GB200 Superchips, achieving 800 TPS on Llama 3.1 405B, and for NVIDIA H200 GPU instances, achieving 33,000 TPS on Llama 2 70B (a 40% improvement over H100). This demonstrates CoreWeave's infrastructure performance for large-model inference.