Cerebras brings instant inference to Mistral Le Chat - Cerebras

Cerebras Inference is now powering Mistral's Le Chat platform, specifically its new Flash Answers feature. This integration achieves over 1,100 token/s for the Mistral Large 2 model, a 10x improvement over popular models. The performance is attributed to the Wafer Scale Engine 3's SRAM-based inference architecture and speculative decoding techniques developed in collaboration with Mistral researchers. The initial release focuses on serving text-based queries.