Working with Students to Improve Indexing in Apache Hive
May 5, 2011John Sichi

Summary
This post details the collaboration with Harvey Mudd Computer Science Clinic students to enhance Apache Hive's indexing capabilities. The students implemented automatic index usage and a new bitmap indexing type, which was tested on smaller scales with encouraging results. The work aims to accelerate complex queries, such as those involving multiple attributes and time ranges, and demonstrated significant space savings and query speedups with bitmap index compression.