Baseten

How we built the fastest Kimi K2.5 on Artificial Analysis

Feb 11, 2026
How we built the fastest Kimi K2.5 on Artificial Analysis
SummaryAI, from the source post

This post details the optimization of Kimi K2.5 inference by converting INT4 weights to NVFP4 for Blackwell GPU compatibility and implementing a custom EAGLE-3 speculator model trained on Kimi K2.5 hidden states. This achieved 340+ tokens per second, significantly improving inference speed for large reasoning models.

More from the Kimi K3 Model API Deployment trail