First-Ever Measured Vera Rubin NVL72 Silicon Performance Stats | CoreWeave Blog

This post provides the first measured silicon performance statistics for the NVIDIA Vera Rubin NVL72 on CoreWeave, specifically comparing its energy efficiency (tokens per megawatt) against NVIDIA Blackwell NVL72 using the DeepSeek R1 model. It details the inference optimizations used (expert parallelism, NVFP4 precision, multi-token prediction, disaggregated prefill/decode via TensorRT-LLM and Dynamo) and quantifies the performance gains in terms of tokens per second per megawatt at matched interactivity targets. The post also discusses the operational layer supporting Vera Rubin NVL72, including liquid cooling and rack control, and anticipates further performance improvements through ongoing software stack optimization.