Building a ubiquitous shared infrastructure using Twine

What this post added

This post details the development and adoption of Twine, Meta's cluster management system, which has enabled the creation of a ubiquitous shared infrastructure. Key contributions include scaling a single control plane to manage one million machines, supporting workload-specific customization through host profiles and the TaskControl API, and optimizing hardware usage with power-efficient small machines. The post highlights the significant increase in shared infrastructure adoption, moving from 15% to 56% of the fleet within a year, and outlines the strategy to achieve full adoption for compute services.