AI Engineer Paris 2026 Main Stage: Google DeepMind, ElevenLabs, Hugging Face & Stripe | Day 2
Sep 23, 2026AI Engineer
Summary
Charles Frye's talk, 'The Low-Latency Inference Engineering Playbook,' directly addresses the engineering challenges of achieving minimal latency in AI inference. This contribution is expected to provide practical, actionable strategies and insights into the methodologies and technologies used to optimize inference speed, likely covering aspects such as efficient model loading (potentially building on concepts like vLLM's loading mechanisms), optimized execution paths, and infrastructure design tailored for rapid response times.
More from the Low-Latency Inference Engineering Playbook trail
- How Inference Keeps Up with Our Insatiable Need for Tokens — Cerebras & Gimlet Labs
- Taming the AI Hardware Cambrian Explosion — Abdul Dakkak, Modular
- Same Model, Different Speed: Why Your Inference Provider Matters — FriendliAI
- Latency Is a Budget. Humanlike Is the Goal. — Jesse Hall, LiveKit
- How MiniMax M3 Was Built: Sparse Attention and Native Multimodality — Olive Song