Leveling up Workers AI: general availability and more new capabilities

This post announces the General Availability of Workers AI, detailing improvements in load balancing for greater reliability and performance, with GPUs deployed in over 150 cities. It highlights significant cost reductions for popular models like Llama 2 and Mistral 7B, and introduces new pricing structures including a free tier of 10,000 neurons per day. New dashboard and playground tools are also introduced. The post announces an expansion of the Hugging Face partnership, adding four new models (Mistral 7B v0.2, Nous Research's Hermes 2 Pro, Google's Gemma 7B, and Starling-LM-7B-beta) served via Hugging Face's TGI backend. A key new capability is the support for Bring Your Own LoRAs (BYO LoRAs) for fine-tuned inference, currently in open beta for specific models and adapter sizes. Additionally, Python support for Cloudflare Workers is launched in open beta, allowing developers to write Workers in Python using Pyodide and integrate with various Cloudflare bindings and frameworks like LangChain.