Cloudflare

How we used OpenBMC to support AI inference on GPUs around the world

Dec 6, 2023Ryan Chow, Giovanni Pereira Zantedeschi, Nnamdi Ajah
How we used OpenBMC to support AI inference on GPUs around the world
SummaryAI, from the source post

This post details the use of OpenBMC to manage and optimize thermal and power consumption for GPU-equipped servers, enabling AI inference workloads. It describes the process of fine-tuning fan PID controllers by adjusting proportional, integral, and derivative gains to maintain GPU temperatures below critical thresholds. It also covers establishing communication with GPU sensors via SMBus and sysfs, and exposing this data through IPMI and Redfish using OpenBMC's Entity-Manager.

More from the Hardware Infrastructure & Performance Optimization trail