Artificial Intelligence Integration & Impact
Workers AI: serverless GPU-powered inference on Cloudflare’s global network

Workers AI: serverless GPU-powered inference on Cloudflare’s global network

9/27/2023 · Phil Wittig, Rita Kozlov, Rebecca Weekly, Celso Martinho, Meaghan Choi

What this post added

Introduced Workers AI, a serverless platform for running AI inference on Cloudflare's global network of GPUs. This enables developers to run popular open-source AI models (e.g., Llama 2, Whisper, ResNet-50) with minimal code via a REST API or Cloudflare Workers/Pages. Key features include privacy by default, pay-as-you-go pricing, and integration with Vectorize for vector database functionality. The service plans to expand its model catalog through a partnership with Hugging Face and increase GPU deployment globally.

Read the original post ↗