Reverse debugging at scale

What this post added

This post introduces a novel reverse debugging technique for large-scale production environments. It details the use of Intel Processor Trace (Intel PT) and eBPF for continuous, low-overhead tracing of CPU activity, enabling engineers to inspect the history of a failing process without rerunning it. The contribution includes the development of a system for quick storage of trace data, decoding and symbolication using LLDB, reconstruction of function call history, and support for latency analysis, ultimately aiming to drastically reduce the time spent debugging production issues.