Deploy Safety: Reducing customer impact from change

This post details the evolution of Slack's Deploy Safety Program, focusing on the investment strategy and the impact of automatic rollbacks. It highlights the shift from manual processes to automated detection and remediation, the development of a Deploy Safety metric (Hours of customer impact from high severity and selected medium severity change-triggered incidents), and the iterative approach to project investment. The post emphasizes the importance of patience with trailing metrics and the critical role of direct outreach to engineering teams for adoption. It also showcases the dramatic improvement in results after automatic rollbacks were introduced, leading to a significant reduction in customer impact hours.