Mistral batch API
Nov 7, 2024
Summary
Introduces a Batch API for model inference, enabling cost-efficient processing of high-volume requests (50% lower cost than synchronous calls). Users upload batch files and download processed outputs. Supported use cases include bulk analysis, summarization, translation, embedding generation, and data labeling. Available for all models on La Plateforme, with rate limits of 1 million ongoing requests per workspace.