Edge Computing with Cloudflare Workers
Our container platform is in production. It has GPUs. Here’s an early look

Our container platform is in production. It has GPUs. Here’s an early look

9/27/2024 · Brendan Irvine-Broque, Thomas Lefebvre, Mike Nomitch

What this post added

This post introduces Cloudflare's new container platform, which runs in production and supports GPUs. It details the platform's architecture, including a global scheduler built on Workers, Durable Objects, and KV, and local schedulers within each location. The platform is runtime-agnostic, supporting gVisor, Firecracker, and QEMU, with evaluation of cloud-hypervisor. It addresses challenges with GPU memory needs, container runtime support, and large image sizes for AI models. The platform powers Workers AI, Browser Rendering, and Workers Builds.

Read the original post ↗