
9/27/2024 · Brendan Irvine-Broque, Thomas Lefebvre, Mike Nomitch
What this post added
This post introduces Cloudflare's new container platform, which runs in production and supports GPUs. It details the platform's architecture, including a global scheduler built on Workers, Durable Objects, and KV, and local schedulers within each location. The platform is runtime-agnostic, supporting gVisor, Firecracker, and QEMU, with evaluation of cloud-hypervisor. It addresses challenges with GPU memory needs, container runtime support, and large image sizes for AI models. The platform powers Workers AI, Browser Rendering, and Workers Builds.