Aligning Velox and Apache Arrow: Towards composable data management

This post details the convergence of Meta's Velox execution engine with Apache Arrow, resulting in three new format layouts in Apache Arrow 15.0.0: StringView, ListView, and Run-End-Encoding (REE). StringView offers improved inlining for short strings, faster comparisons, and flexible data layout. ListView enables out-of-order writes for variable-sized containers, facilitating efficient conditional execution. REE adds support for constant and run-length-encoded data, common in data warehousing. This convergence aims to create a more unified and composable data landscape.