Data Warehousing and Analytics Platform
Beringei: A high-performance time series storage engine

Beringei: A high-performance time series storage engine

2/3/2017 · Justin Teller

What this post added

This post details the development and open-sourcing of Beringei, a high-performance in-memory time series storage engine designed to address the scaling limitations of HBase for Facebook's monitoring infrastructure. It introduces a lossless streaming compression algorithm that achieves over 90% compression for time series data by using delta-of-delta encoding for timestamps and XOR-based compression for values. Beringei offers very fast write rates and low read latencies, storing up to 10 billion unique time series and serving 18 million queries per minute, powering Facebook's real-time performance and health monitoring.

Read the original post ↗