KernelEvolve: How Meta’s Ranking Engineer Agent Optimizes AI Infrastructure

Introduces KernelEvolve, an agentic AI system that automates the generation and optimization of low-level hardware kernels for heterogeneous AI accelerators (NVIDIA GPUs, AMD GPUs, MTIA silicon, CPUs). KernelEvolve treats kernel optimization as a search problem, using a job harness to compile, evaluate correctness and performance, and profile hundreds of candidate kernels. This approach compresses weeks of expert engineering time into hours, achieving over 60% inference throughput improvement for the Andromeda Ads model on NVIDIA GPUs and over 25% training throughput improvement on MTIA silicon. It injects platform-specific documentation into LLM context for hardware-agnostic kernel generation and distills successful optimizations into reusable patterns.