Mixtral Sparse Mixture of Experts Model
Bringing open AI models to the frontier

Bringing open AI models to the frontier

9/27/2023

What this post added

This post announces the release of Mistral 7B, a 7.3B parameter model that outperforms open models up to 13B parameters on English and code benchmarks. It highlights the development of a new MLops stack and a sophisticated data processing pipeline from scratch. The post also reiterates Mistral AI's commitment to open models and mentions ongoing work on larger models and novel architectures.

Read the original post ↗