CoreWeave Earns NVIDIA Exemplar Validation for GB200

CoreWeave achieves NVIDIA Exemplar Cloud validation for inference on the NVIDIA GB200 NVL72 platform, demonstrating high inference throughput and latency results that meet NVIDIA's reference architecture standards. The post details the specific inference benchmark tests conducted (Reasoning, Chat, Summarization, Generation, Disaggregation) across DeepSeek-R1, Llama 3.3, and GPT-OSS models, measuring TPS/GPU and Time-to-First-Token (TTFT) latency. It highlights the use of NVIDIA Dynamo for multi-node inference and TRT-LLM as the backend. The post also emphasizes the role of CoreWeave Mission Control and its GPU Straggler Detection feature in monitoring and ensuring performance and reliability during these benchmarks.