How we used OpenBMC to support AI inference on GPUs around the world
Dec 6, 2023Ryan Chow, Giovanni Pereira Zantedeschi, Nnamdi Ajah

Summary
This post details the use of OpenBMC to manage and optimize thermal and power consumption for GPU-equipped servers, enabling AI inference workloads. It describes the process of fine-tuning fan PID controllers by adjusting proportional, integral, and derivative gains to maintain GPU temperatures below critical thresholds. It also covers establishing communication with GPU sensors via SMBus and sysfs, and exposing this data through IPMI and Redfish using OpenBMC's Entity-Manager.
More from the Hardware Infrastructure & Performance Optimization trail
- How we reduced core unit boot time from hours to minutes
- A one-line Kubernetes fix that saved 600 hours a year
- Inside Gen 13- how we built our most powerful server yet
- Launching Cloudflare’s Gen 13 servers- trading cache for cores for 2x edge compute performance
- So long, and thanks for all the fish- how to escape the Linux networking stack