Cloudflare’s 12th Generation servers — 145% more performant and 63% more efficient
Sep 25, 2024JQ Lau, Ma Xiong, Syona Sarma
Summary
This post details the introduction of Cloudflare's Gen 12 servers, powered by AMD EPYC 9684X (Genoa-X) processors. Key technical contributions include: a 145% increase in performance (requests per second) and a 63% improvement in power efficiency (RPS per watt) compared to Gen 11 servers. Specific hardware details are provided: 96-core Genoa-X CPU with 1152MB L3 cache, 384GB DDR5 RAM, 16TB NVMe storage, dual 25 GbE NICs, and 800W PSUs. The design choice to double server chassis height (2U1N) for improved cooling efficiency is highlighted, reducing system power consumption to 600W. The integration of hardware root of trust (HRoT) and modular OCP DC-SCM for baseboard management is also detailed, supporting openBMC.
More from the Hardware Infrastructure & Performance Optimization trail
- How we reduced core unit boot time from hours to minutes
- A one-line Kubernetes fix that saved 600 hours a year
- Launching Cloudflare’s Gen 13 servers- trading cache for cores for 2x edge compute performance
- Inside Gen 13- how we built our most powerful server yet
- So long, and thanks for all the fish- how to escape the Linux networking stack