Data @Scale – Boston recap

This post summarizes presentations from the Data @Scale conference in Boston, highlighting advancements in data systems. Key contributions include techniques for leveraging sampling to reduce data warehouse resource consumption at Facebook, improving approximate query results and offsetting compute/storage demand. It also covers the evolution of Apache Cassandra with Transient Replication and Cheap Quorums for disk space and compute savings, and Facebook's Deletion Framework for managing data deletion across distributed systems. Other contributions include Wayfair's transformation of data plumbing with Tremor, HubSpot's migration of Elasticsearch instances for GDPR compliance, and the development of Presto's Cost-Based Optimizer (CBO) for performance improvements in join operations and statistics collection.