
9/27/2023 · Phil Wittig, Rita Kozlov, Rebecca Weekly, Celso Martinho, Meaghan Choi
What this post added
Introduced Workers AI, a serverless platform for running AI inference on Cloudflare's global network of GPUs. This enables developers to run popular open-source AI models (e.g., Llama 2, Whisper, ResNet-50) with minimal code via a REST API or Cloudflare Workers/Pages. Key features include privacy by default, pay-as-you-go pricing, and integration with Vectorize for vector database functionality. The service plans to expand its model catalog through a partnership with Hugging Face and increase GPU deployment globally.