Mistral AI

Mistral batch API

Nov 7, 2024
Mistral batch API
SummaryAI, from the source post

Introduces a Batch API for model inference, enabling cost-efficient processing of high-volume requests (50% lower cost than synchronous calls). Users upload batch files and download processed outputs. Supported use cases include bulk analysis, summarization, translation, embedding generation, and data labeling. Available for all models on La Plateforme, with rate limits of 1 million ongoing requests per workspace.