Data Warehousing and Analytics Platform
ZooKeeper Meetup@Facebook: Advancing the state of distributed coordination

ZooKeeper Meetup@Facebook: Advancing the state of distributed coordination

2/6/2020

What this post added

This post details advancements in ZooKeeper at Facebook, including a 10x improvement in write throughput via snapshot scheduler changes and batch commits. It also covers optimizing semaphores with a new lock API to reduce server round trips and QPS. Scalability improvements include demand control for multitenancy (data size and request rate quotas) to mitigate noisy neighbor issues, and zero-downtime migration strategies. Furthermore, the entire ZooKeeper fleet has been containerized, moving away from bare-metal deployments, simplifying fleet management and deployments.

Read the original post ↗