Workers AI: serverless GPU-powered inference on Cloudflare’s global network
Sep 27, 2023Phil Wittig, Rita Kozlov, Rebecca Weekly, Celso Martinho, Meaghan Choi
Summary
Introduced Workers AI, a serverless platform for running AI inference on Cloudflare's global GPU network. It offers a curated set of open-source models (LLMs, ASR, translation, classification, image classification, embeddings) accessible via Workers, Pages Functions, or a REST API. The platform emphasizes developer experience, privacy by default (no model training on user data), and pay-as-you-go pricing. It integrates with Vectorize for building context-aware AI applications.
More from the Artificial Intelligence Integration & Impact trail
- Introducing Clef-omni with full multimodality, plus a faster Clef and a cheaper Clef-flash
- Introducing Web Search API via AI Gateway
- Introducing Clef: our open-source decision models, and new RL fine-tuning platform
- One year later: Sovereign AI and the fight for choice
- AI Search is now generally available