TechPrufer
Get started
Yahoo
Yahoo logoYahoo · Feature trail

OpenTSDB Rollup and Pre-Aggregation Storage

1 post · Dec 2018

What this trail covers

OpenTSDB 2.4.0 introduces Rollup and Pre-Aggregation Storage to manage growing time series data by storing lower-resolution data for longer periods and pre-aggregating data to speed up queries. This release also adds support for Histograms and Data Sketches for accurate percentile calculations across multiple series, HBase Date Tiered Compaction, a new authentication plugin interface, direct data fetching from Bigtable/HBase via search indexes, improved UID cache controls, and configurable query size and time limits.

All Yahoo trails
  1. Announcing OpenTSDB 2.4.0: Rollup and Pre-Aggregation Storage, Histograms, Sketches, and MoreThis post announces OpenTSDB 2.4.0, detailing the implementation of Rollup and Pre-Aggregation Storage for efficient long-term data retention and faster querying of aggregated data. It also introduces support for Histograms and Data Sketches (specifically mentioning Yahoo's Data Sketches library) for accurate percentile calculations across multiple time series, addressing a mathematical limitation of combining individual percentile data. Additional features include HBase Date Tiered Compaction, a new authentication plugin interface, direct data fetching from Bigtable/HBase via search indexes, enhanced UID cache controls, and configurable query limits.