Waiter: Distributed Auto-Scaler

Two Sigma developed Waiter, an open-source distributed auto-scaler that provides request-level scaling for services. It supports service versioning and manages service lifecycles, automatically reaping inactive versions. Waiter has been used in production for over two years, handling hundreds of millions of requests per day. It is agnostic to underlying cluster managers and can run existing HTTP services without modification.