How Netflix Simplified Batch Compute with Kueue

This post details the migration of Netflix's custom batch compute management system (CMB) to Kueue, an open-source Kubernetes-native job queueing system. The migration involved replacing CMB's queuing and scheduling logic with Kueue, integrating it into the Titus container platform, and re-architecting tenant management to map to Kueue's Cohorts, ClusterQueues, and LocalQueues. Key technical challenges addressed included maintaining API parity, migrating complex use cases early, and tuning Kueue for high QPS and throughput. The post highlights the benefits of Kueue, such as preemption and fair sharing, leading to improved resource utilization and faster turnaround times for critical workloads.