Data Warehousing and Analytics Platform
Even faster: Data at the speed of Presto ORC

Even faster: Data at the speed of Presto ORC

3/17/2015 · Dain Sundstrom

What this post added

This post details the development and integration of a new ORC reader for Presto, designed to significantly improve data processing performance. Key contributions include enabling columnar reads, implementing predicate pushdown by leveraging ORC's min/max statistics, and introducing lazy reads to optimize data access based on query predicates. The new reader supports both ORC and DWRF formats and demonstrates substantial speedups in raw decoding and end-to-end query latency compared to previous implementations and other data formats like RCFile and Parquet.

Read the original post ↗