Mercury 2, the first reasoning diffusion LLM, is now on Baseten

This post introduces the integration of Inception's Mercury 2, a diffusion LLM (dLLM), onto the Baseten platform. It highlights the dLLM architecture's inherent speed advantage over autoregressive models by drafting and refining outputs in parallel passes. The post details how Baseten's infrastructure, including NVIDIA GPU support (Hopper H100, Blackwell), Baseten Frontier Gateway for rate limiting and routing, and autoscaling, enables production-grade deployment of these dLLMs. It showcases real-world results from Augment Code, demonstrating an 82% reduction in compaction latency and a 90% cost reduction by using Mercury 2 for specific subagent tasks within a multi-model system.