Coreweave

CoreWeave Achieves New Record-Breaking AI Inferencing Benchmark with NVIDIA GB200 Grace Blackwell Superchips

Apr 2, 2025
CoreWeave Achieves New Record-Breaking AI Inferencing Benchmark with NVIDIA GB200 Grace Blackwell Superchips
SummaryAI, from the source post

CoreWeave submitted MLPerf v5.0 Inference Closed results for NVIDIA GB200 Superchips, achieving 800 TPS on Llama 3.1 405B, and for NVIDIA H200 GPU instances, achieving 33,000 TPS on Llama 2 70B (a 40% improvement over H100). This demonstrates CoreWeave's infrastructure performance for large-model inference.

More from the ML Inference Benchmarking trail