NVIDIA Vera CPU Sets a New Standard for Agentic Workloads in AI Factories | NVIDIA Technical Blog

What this post added

This post introduces the NVIDIA Vera CPU as a new design point for AI factories, specifically addressing the increased importance of CPU performance in agentic AI and reinforcement learning workloads. It details how the Vera CPU, with its 88 NVIDIA Olympus cores and 1.2 TB/s LPDDR5X memory bandwidth, delivers high per-core performance, concurrency, and energy-efficient memory bandwidth. Key architectural features like the neural branch predictor, wide decode unit, deep out-of-order engine, graph prefetcher, and NVIDIA Scalable Coherency Fabric are highlighted for their role in accelerating agentic tasks such as sandboxed code execution, data retrieval, and orchestration. Performance benchmarks show over 1.8x higher agentic sandbox performance compared to x86-based architectures.