Experimentation

Hex has evolved its experimentation capabilities by providing a comprehensive guide to performing A/B tests. This includes understanding the core concepts of A/B testing, defining hypotheses (null and alternative), selecting appropriate metrics like user retention, and performing exploratory data analysis to check for sample ratio mismatch (SRM). The post details how to handle SRM by random sampling and demonstrates statistical testing using chi-square tests to validate hypotheses. It also covers visualization techniques like kernel density estimation to better understand retention rates across different groups.