Ready-to-go sample data pipelines with Dataflow
Dec 16, 2022Netflix Technology Blog

Summary
This post introduces Dataflow, a CLI utility designed to streamline data pipeline development at Netflix. It details the 'sample workflows' feature, which provides ready-to-go templates for bootstrapping batch data pipelines. The post outlines the business logic (top 100 movies/shows per country) and common components (workflow definitions, DDL, transformation jobs, audits, unit tests) used in these sample pipelines, illustrating how they can be adapted for different languages and use cases.