Cerebras Brings Kimi K2.6 Inference to Enterprises

Cerebras has achieved 981 output tokens per second running the Kimi K2.6 trillion-parameter open-weight model, a world record for this class of model. This performance is attributed to the Cerebras Wafer-Scale Engine's architecture, which distributes 4-bit weights across multiple wafers and streams activations between them. On-wafer network fabric provides over 200x the bandwidth of NVLink for all-to-all communications between layers. Custom kernels and speculative decoding further contribute to the high throughput. This enables agentic coding workflows to achieve near-instantaneous response times, with a 10,000-token input request (including prompt processing, reasoning, and generating 500 output tokens) completed in 5.6 seconds, a 29x improvement over the official Kimi endpoint.