Coming Soon: Confidence — An Experimentation Platform from Spotify
Aug 1, 2023Tyson Singer, Head of Technology and Platforms
Summary
This post announces the upcoming commercial release of Spotify's internal experimentation platform, named Confidence. It details the evolution of Spotify's experimentation capabilities over the past decade, from early manual A/B tests with ABBA to the current sophisticated platform. Key technical advancements mentioned include the development of a Metrics Catalog for self-service metric analysis and a coordination engine for managing mutually exclusive experiments and holdback groups. The post also outlines the three ways Confidence will be available to customers: managed service, Backstage plugin, and APIs, highlighting the flexibility and scalability of the platform.
More from the Experimentation Platform trail
- Why Spotify Is Not Using Bayesian A/B Testing | Spotify Engineering
- When Can LLMs Replace Humans in A/B Tests? | Spotify Engineering
- Better Experiments with LLM Evals — A funnel, not a fork | Spotify Engineering
- Why We Use Separate Tech Stacks for Personalization and Experimentation
- Beyond Winning: Spotify’s Experiments with Learning Framework