Data Canary for Catalog Metadata Validation

Netflix is evolving its data validation strategies by introducing a 'Data Canary' system for catalog metadata. This system treats data deployments with the same rigor as code deployments, using production traffic to validate transformations in near real-time. It aims to detect data corruption issues in under 10 minutes, preventing bad data from reaching members and ensuring streaming reliability. The system utilizes a dedicated orchestrator pattern, extends the chaos platform with custom thresholds and sticky canaries, and focuses on behavioral metrics like Starts Per Second (SPS) for immediate abort on regression.