Property Based Testing Confluent Cloud Storage for Fun and Safety

What this post added

This post introduces the application of property-based testing, specifically stateful testing with ScalaCheck, to validate the safety and correctness of Confluent Cloud's Tiered Storage feature. It details the design of an initial state generator, action generators (including Append, Retention, TierUploadSegment, CommitTierState), and the core properties checked to ensure data integrity, prevent premature deletion, and verify correct data exposure. The post also explains the concepts of log segments, retention, and the high watermark in the context of this testing methodology.