TC4D: Data Quality By Engineers, For Engineers

This post introduces TC4D (Test Certified for Data-Focused teams), a gamified program designed to improve testing practices and test coverage for data-focused teams at Spotify. It addresses the lack of standardization in big data quality and the inconsistent test coverage across pipelines. TC4D consists of three certification levels focusing on setup, monitoring, alerting, unit tests, security, and data quality. The program is driven by mentors and aims to encourage adoption of best practices through encouragement and trust in engineers' decision-making.