NVIDIA Vera Rubin and Blackwell Set a New Standard for Agentic AI Performance per Watt | NVIDIA Technical Blog

This post introduces NVIDIA Vera Rubin NVL72 and its performance improvements for agentic AI workloads, specifically using the SemiAnalysis AgentX benchmark. It details how Vera Rubin NVL72 achieves up to 30x higher AI-factory throughput per megawatt than GB300 NVL72 at 160 tokens per second per user on the AgentX DeepSeek V4-Pro workload. The post also highlights system-level optimizations such as MoE serving runtimes (SGLang, TensorRT-LLM, vLLM), DeepGEMM-based kernels with MXFP4 and MXFP8 formats, NVIDIA Dynamo for disaggregated prefill and decode, and NVLink scale-up fabric, which collectively enable responsive multi-turn serving for agent sessions.