Introducing Oak: an Open Source Scalable Key-Value Map for Big Data Analytics
Sep 13, 2018
Summary
Introduces OakMap, a new open-source concurrent ordered key-value map implemented in Java. OakMap utilizes off-heap memory allocation and a two-level index to achieve superior scalability and performance compared to existing solutions like ConcurrentSkipListMap, particularly for analytics workloads. It details the memory scaling benefits due to reduced GC overhead, query speed improvements from data locality, and update speed advantages through in-situ computation on embedded objects. The post also highlights its integration with Apache Druid.