TechPrufer
Get started
Mistral AI
Mistral AI logoMistral AI · Feature trail

Batch API for Model Inference

1 post · Nov 2024

What this trail covers

Mistral AI introduces a Batch API for its models, offering a more cost-efficient way (50% lower cost) to process high-volume requests compared to synchronous API calls. This feature is ideal for applications prioritizing data volume over synchronous responses, enabling users to upload batch files and download processed outputs. Popular use cases include bulk customer feedback analysis, document summarization and translation, vector embedding generation, and data labeling. The Batch API is available for all models served on la Plateforme, and coming soon to our cloud provider partners. Rate of usage is limited to 1 million ongoing requests per workspace.

All Mistral AI trails
  1. Mistral batch APIIntroduces a Batch API for model inference, enabling cost-efficient processing of high-volume requests (50% lower cost than synchronous calls). Users upload batch files and download processed outputs. Supported use cases include bulk analysis, summarization, translation, embedding generation, and data labeling. Available for all models on La Plateforme, with rate limits of 1 million ongoing requests per workspace.