Introducing Mistral Small 4 | Mistral AI

Introduces Mistral Small 4, a unified model combining reasoning, multimodal, and agentic coding capabilities. Key architectural details include a Mixture of Experts (MoE) with 128 experts (4 active per token), 119B total parameters (6B active), and a 256k context window. It features configurable reasoning effort via the `reasoning_effort` parameter and native multimodality. Performance highlights include a 40% reduction in end-to-end completion time and 3x more requests per second compared to Mistral Small 3. The post details enterprise-grade efficiency requirements (NVIDIA HGX H100/H200, DGX B200) and emphasizes its open-source nature with availability on various inference engines and optimization with NVIDIA NIM and NeMo.