Managing Machines at Spotify

This post details the evolution of Spotify's machine management infrastructure, moving from manual processes and centralized operations to a self-service model. Key developments include the automation of DNS pushes, machine ingestion via iPXE and a pxeimage, and provisioning requests with Provgun and later Provcannon. The introduction of Neep (a job queue for machine operations like install/recycle) and Sid (a REST service integrating ServerDb, microservice ownership data, and Neep jobs) enabled engineers to manage machine capacity via a web UI, significantly reducing turnaround times from weeks to hours.