Leveling up Workers AI: general availability and more new capabilities

What this post added

This post announces the General Availability (GA) of Workers AI, a serverless GPU inference platform. Key improvements include enhanced load balancing for increased reliability and performance, routing requests to GPUs in over 150 cities globally, and significantly increased rate limits. Pricing has been optimized, making popular models like Llama 2 and Mistral 7B considerably cheaper. New dashboard and playground tools are introduced for better analytics and model testing. The partnership with Hugging Face is expanded, offering more curated models and a direct integration button. A significant new capability is Bring Your Own LoRA (BYO LoRA) support for fine-tuned inference, allowing users to apply LoRA adapters to base models at runtime. Additionally, Cloudflare Workers now support Python, enabling developers to write Workers in Python using frameworks like LangChain and Pyodide.