Improving platform resilience at Cloudflare through automation
Oct 9, 2024Opeyemi Onikute

Summary
This post details the development of an automatic remediation system built on Temporal to handle infrastructure failures. It introduces a coordinator for authorization and scheduling of workflows, enforces safety constraints using HCL, and leverages Temporal's Task Routing for efficient execution across different server types and locations. The system is triggered by various sources like Prometheus and alerting systems, enabling automated self-healing of platform components.