BlogsNetflixBatch Compute Management

Batch Compute Management

Batch Compute Management

1
posts
2026

Netflix has evolved its batch compute management by migrating from a custom-built solution (CMB) to an open-source Kubernetes-native system, Kueue. This transition aims to simplify batch job execution, enhance resource utilization through fair sharing and preemption, and leverage the Kubernetes ecosystem for greater flexibility and innovation. The migration involved integrating Kueue into their existing container platform, Titus, and re-architecting tenant and capacity management to align with Kueue's concepts of ClusterQueues and LocalQueues. This has resulted in managing millions of batch workloads, improved resource utilization, and the productionization of preemption for better capacity management.

2026

How Netflix Simplified Batch Compute with Kueue

6/22/2026

This post details the migration of Netflix's custom batch compute solution (CMB) to Kueue, an open-source Kubernetes-native job queueing system. It explains the motivations for the migration, including the limitations of CMB and the advantages of Kueue (e.g., native preemption, integration with existing schedulers). The post outlines the migration strategy, emphasizing transparency for end-users and zero regressions in performance. It describes the architectural changes, mapping CMB tenants to Kueue's Cohorts, ClusterQueues, and LocalQueues. Key lessons learned, such as maintaining API parity and migrating complex use cases early, are shared. The current state highlights the successful rollout of Kueue managing millions of jobs, with a focus on enhanced fair sharing and preemption features leading to increased resource utilization.