How we improved on-call life by reducing pager noise

What this post added

This post details the implementation of alert grouping by service and service dependency-based alert inhibition using Alertmanager to reduce pager noise for on-call engineers. It explains how alerts are grouped by the 'type' and 'env' labels, and how 'inhibition' rules are used to prevent cascading alerts when downstream services degrade. The post also outlines the process of defining service dependencies within the metrics-catalog and the restrictions applied to inhibit rules. The improvements observed include a reduction in pages per service and a downward trend in overall pages for the on-call.