Tangle: An open-source ML experimentation platform built for scale (2025) - Shopify

Shopify has open-sourced Tangle, an ML experimentation platform built to accelerate ML development by addressing six common failure modes: manual query tracking, unstructured notebooks, repeated data preparation, inability to recreate results, slow deployment, and lack of sharing. Tangle offers a platform-agnostic, language-neutral architecture with visual pipeline editing (DAGs), robust content-based caching (global artifact reuse), and a declarative component model defined in YAML. It executes arbitrary containerized CLI programs, allowing users to build pipelines with components written in any language. The platform's caching mechanism reuses identical computations based on output content hashes, significantly reducing execution time. Tangle also features an optional type system for metadata and tooling, and a visual editor for pipeline development and real-time monitoring.