The Unreasonable Effectiveness of Test Retries: An Android Monorepo Case Study - Shopify

This post details the implementation of test retries to improve CI pass rates in an Android monorepo. It introduces the concept of retriable, fatal, and test failures, with specific retry strategies for each. The post also highlights the importance of caching to reduce reliance on unreliable components and provides recommendations for making components more reliable. The theoretical pass rate of the CI suite increased from 35% to 99.95% by implementing retries.