Workers AI Update: Hello, Mistral 7B!

What this post added

This post announces the addition of the Mistral-7B-v0.1-instruct model to Workers AI, providing code examples for both REST API and Worker script usage. It delves into the technical details of attention mechanisms in large language models, specifically explaining Scaled Dot-Product Attention, Multi-Head Attention, Multi-Query Attention, and Grouped-Query Attention (used by Mistral 7B), including diagrams and performance implications. It highlights Mistral 7B's advantages in speed and performance due to grouped-query attention and sliding window attention.