Managing resources for large-scale testing

This post introduces One World, a new unified resource management system for large-scale testing at Facebook. It details the architecture, including runtime worker services, the One World daemon, and the Jupiter scheduler. It explains how One World manages tens of thousands of resources (mobile devices, browsers, emulators) and executes over a million jobs daily. The post highlights the challenges of device reliability and the solutions implemented, such as state machines for worker services, health checks, and state restoration. It also describes the mechanisms for remote access to Android (via adb tunnels) and iOS (via FBSimulatorControl and WebDriverAgent) devices, and the role of the One World daemon in session management and resource leasing. The satellite mode for connecting local devices to the global system is also presented.
More from the Scalability and Large-Scale Systems Engineering trail
- Open-Sourcing Rebalancer: A Generic, High-Performance Library for Solving Assignment Problems
- ZGateway: Learnings from Putting a Proxy in Front of ZippyDB
- MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines
- From User Sequences to Scaling Laws: A Multi-Stage Architecture for Meta’s Ads Ranking
- GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model