Mistral Moderation API | Mistral AI

Mistral AI releases a new content moderation API, which is the same API powering the moderation service in Le Chat. It offers two endpoints: one for raw text and one for conversational content, classifying the last message of a conversation within a conversational context. The model is natively multilingual and trained on 11 languages. It classifies text inputs into 9 categories and addresses model-generated harms like unqualified advice and PII. Performance is shared via AUC PR across policies on an internal testset.