Executing Cron Scripts Reliably At Scale

This post details the design and implementation of a new reliable and scalable cron execution service. Key contributions include: 1. The 'Scheduled Job Conductor' Golang service using a cron library and Kubernetes Leader Election for high availability, offloading compute to the Job Queue. 2. Integration with Slack's Job Queue for asynchronous, high-volume job execution. 3. Utilization of a Vitess table for job deduplication (replacing flock) and state tracking, enabling monitoring and preventing concurrent script runs. The post also discusses the rationale for a single scheduling leader and offloading compute.