Presto: Interacting with petabytes of data at Facebook

This post introduces Presto, a new distributed SQL query engine designed for interactive speed at petabyte scale. It details Presto's architecture, which differs from Hive/MapReduce by using a custom in-memory, pipelined execution engine to reduce latency. It highlights Presto's extensibility through connectors for various data sources (HDFS, HBase, Scribe, custom systems) and its implementation in Java with dynamic bytecode compilation. The post also covers Presto's current status, including its production deployment at Facebook, scale to 1,000 nodes, daily processing of one petabyte, and performance improvements over Hive/MapReduce. Future roadmap items and the open-sourcing of Presto are also announced.