Zoomer: Powering AI Performance at Meta’s Scale Through Intelligent Debugging and Optimization

What this post added

This post introduces Zoomer, Meta's comprehensive, automated debugging and optimization platform for AI training and inference workloads. Zoomer provides deep performance insights to improve energy savings, accelerate workflows, and enhance efficiency across Meta's AI infrastructure, delivering training time reductions and significant QPS improvements. It details Zoomer's architecture, profiling mechanisms, data capture, distributed analysis pipeline, and specialized workload support for training, inference, and GenAI.