Open-sourcing StateService: Automating recovery of third-party services after a major outage
Oct 4, 2018Declan Ryan

Summary
This post introduces and open-sources StateService, a state machine as a service designed to automate the recovery of third-party services after major outages. StateService directs the state of VMs through complex deployment processes, reducing manual effort and recovery time. It integrates with configuration management software like Chef, using YAML to describe state transitions and HTTP for communication. This allows for programmatic control over deployment steps, ensuring they occur in the correct sequence and on specific VMs.
More from the Site Reliability and Outage Management trail
- Lights Out, Systems On: Validating Instant Power Loss Readiness
- DrP: Meta’s Root Cause Analysis Platform at Scale
- Zoomer: Powering AI Performance at Meta’s Scale Through Intelligent Debugging and Optimization
- Diff Risk Score: AI-driven risk-aware software development
- How Meta keeps its AI hardware reliable