Agentic kernels in production
Aug 29, 2026
Summary
Introduced an agentic kernel development framework that automates the identification, generation, and validation of optimized kernels for production AI models. This framework addresses the gap between kernel benchmarks and production deployment by considering workload-specific configurations, downstream dependencies, higher-level computation restructuring, and seamless integration into serving engines. Achieved 42.3% end-to-end latency reduction on Qwen-Image and 15.2% on FLUX.2, along with a 5.5% increase in tok/s on MiniMax M3 through optimizations like pre-packed FP8 scales, fused QKV projection and epilogue, normalization + quantization kernel fusion, bias absorption, and CFG modulation cache.
More from the Baseten AI Model Deployment and Serving Platform trail
- LangChain trains custom models for LangSmith Engine with Baseten Loops
- DeepSeek-V4.1-Flash: more efficient prefill for coding agents
- Blaxel is joining Baseten to build the future of agentic infrastructure
- How Baseten makes pyannote’s diarization models 9.6x faster
- Optimizing delta weight syncs for managed rollouts