Yahoo

Introducing Oak: an Open Source Scalable Key-Value Map for Big Data Analytics

Sep 13, 2018
Introducing Oak: an Open Source Scalable Key-Value Map for Big Data Analytics
SummaryAI, from the source post

Introduces OakMap, a new open-source concurrent ordered key-value map implemented in Java. OakMap utilizes off-heap memory allocation and a two-level index to achieve superior scalability and performance compared to existing solutions like ConcurrentSkipListMap, particularly for analytics workloads. It details the memory scaling benefits due to reduced GC overhead, query speed improvements from data locality, and update speed advantages through in-situ computation on embedded objects. The post also highlights its integration with Apache Druid.

More from the HaloDB Embedded Key-Value Storage Engine trail