Beyond synthetic testing: Capturing and replaying real database workloads at Airbnb

This post details the design and implementation of a novel database traffic capture and replay system at Airbnb. Key technical contributions include: 1. Leveraging ProxySQL as a client-agnostic capture point without application changes. 2. A Log Mover sidecar for efficient log transfer to object storage. 3. A Log Processor that parses binary logs, groups by backend, reassembles transactions, buckets by time window, and rewrites INSERT statements to pin auto-increment IDs for compatibility testing. 4. A Log Replayer with 'replay only' and 'replay and compare' modes, featuring an API server, task scheduler, and workers that use a shared start signal to reproduce original timing and concurrency.