Extract More Kernel Performance with NVIDIA CompileIQ Auto-Tuning | NVIDIA Technical Blog

Introduces NVIDIA CompileIQ, an AI-powered compiler auto-tuning framework integrated into CUDA 13.3. CompileIQ uses evolutionary and genetic algorithms to optimize NVIDIA GPU compilers for specific workloads by exploring internal compiler parameters not exposed by public flags. It targets critical kernel hotspots (e.g., in LLM inference) to achieve fractional performance gains. The framework supports multi-objective optimization (runtime, compile time, power) and generates reproducible, portable, and secure Advanced Controls Files (ACFs). The post provides a Python-based workflow for defining objectives, configuring the search, and running the optimization, along with example code.