NVIDIA Vera CPU Boosts AI Factory Throughput to Accelerate Agentic Workloads | NVIDIA Technical Blog

This post details how the NVIDIA Vera CPU architecture addresses bottlenecks in agentic AI workloads by providing significantly improved sustained per-core performance under full socket load. It highlights Vera's 1.8x faster cores for RL training throughput, its monolithic design with 88 Olympus cores for 40% lower peak loaded latency and over 3x per-core memory bandwidth at half the power of traditional x86 CPUs for agentic inference, and its ability to minimize CPU-side stalls and KV-cache evictions to maximize GPU utilization and session efficiency.