TechPrufer
Get started
Spotify
Spotify logoSpotify · Feature trail

Bigtable Autoscaler

1 post · Nov 2018

What this trail covers

Spotify developed and open-sourced the Bigtable Autoscaler, a service that automatically adjusts the number of nodes in a Bigtable cluster to optimize for CPU utilization and storage capacity. It supports configurable min/max nodes, CPU targets, and overload steps, and includes features for handling batch jobs and exponential backoff for error handling. Future improvements include predictive scaling using Facebook Prophet.

All Spotify trails
  1. Bigtable Autoscaler: saving money and time using managed storageThis post introduces the Bigtable Autoscaler, a new service developed by Spotify to automate the rightsizing of Google Cloud Bigtable clusters. It details the autoscaler's configuration options (min/max nodes, CPU target, overload step), its operational logic (gathering metrics every 30 seconds, applying scaling rules), and its support for batch jobs via a dedicated endpoint. The post also outlines the quick start guide for deployment and future plans for predictive scaling using Facebook Prophet.