Hardware Infrastructure & Performance Optimization
How we used OpenBMC to support AI inference on GPUs around the world

How we used OpenBMC to support AI inference on GPUs around the world

12/6/2023 · Ryan Chow, Giovanni Pereira Zantedeschi, Nnamdi Ajah

What this post added

This post details the use of OpenBMC to manage and optimize thermal and power consumption for GPU-equipped servers, enabling AI inference workloads. It describes the process of fine-tuning fan PID controllers by adjusting proportional, integral, and derivative gains to maintain GPU temperatures below critical thresholds. It also covers establishing communication with GPU sensors via SMBus and sysfs, and exposing this data through IPMI and Redfish using OpenBMC's Entity-Manager.

Read the original post ↗