Batch API for Model Inference
Mistral batch API

Mistral batch API

11/7/2024

What this post added

Introduces a new Batch API for Mistral models, enabling asynchronous, high-volume request processing at a reduced cost. This addresses the need for efficient processing of large datasets for tasks like sentiment analysis, bulk summarization/translation, and embedding generation, by allowing users to upload batch files and retrieve results asynchronously.

Read the original post ↗