Tangle: An open-source ML experimentation platform built for scale (2025) - Shopify

What this post added

This post introduces Tangle, an open-source ML experimentation platform developed at Shopify. It details the platform's motivation, addressing six common ML development failure modes. The core architecture is explained, focusing on platform agnosticism, robust content-based caching, visual pipeline editing, and a language-neutral design. Key concepts like Components, Tasks, Executions, and Graphs are defined. The post highlights Tangle's communication through file paths, its execution flow, and an optional type system. It also describes the visual editor for pipeline development and monitoring, and provides getting started instructions via HuggingFace.