Preventing performance regressions with Health Compass and Incident Tracker

What this post added

This post introduces Health Compass and Incident Tracker, two new systems designed to unify and streamline the process of preventing performance regressions in Meta's codebase. Health Compass provides a single configuration interface for describing performance scenarios, ensuring consistent metrics and metadata across various analysis tools. Incident Tracker leverages these scenarios to perform time-series regression detection (week-over-week and release-over-release) for beta and production analytics, consolidating relevant data to aid investigation and deduplicating issues across different environments. The systems aim to reduce distracting alerts and improve the efficiency of performance monitoring throughout the development lifecycle.