NVIDIA Vera CPU Sets a New Standard for Agentic Workloads in AI Factories | NVIDIA Technical Blog

This post introduces the NVIDIA Vera CPU and its suitability for agentic AI workloads. It details how the Vera CPU, with its 88 NVIDIA Olympus cores and 1.2 TB/s LPDDR5X memory bandwidth, addresses the increasing importance of CPU performance in the agentic AI loop. The post highlights the Olympus core's architectural improvements (wide front end, advanced branch prediction, deep out-of-order execution) and the memory subsystem's low latency and high bandwidth. It quantifies the performance gains, showing over 1.8x higher sandbox performance compared to x86 architectures in agentic workloads. The article also discusses the shift in AI factory metrics from 'cores per dollar' to 'tokens per dollar' and how Vera CPU's design aligns with this new paradigm.