Mistral NeMo | Mistral AI

This post introduces Mistral NeMo, a 12B parameter model developed in collaboration with NVIDIA. Key technical contributions include a large context window of 128k tokens, state-of-the-art performance in reasoning, world knowledge, and coding accuracy for its size category, and FP8 inference enabled by quantization awareness. A new tokenizer, Tekken, is introduced, which is more efficient at compressing natural language text and source code across many languages compared to previous tokenizers. The model is released under the Apache 2.0 license as pre-trained base and instruction-tuned checkpoints, and is available via la Plateforme and as an NVIDIA NIM inference microservice.