Databricks

Granular Usage Attribution for dbt Pipelines with Query Tags - Cloned

Apr 21, 2024
Granular Usage Attribution for dbt Pipelines with Query Tags - Cloned
SummaryAI, from the source post

This post introduces the use of query tags in Databricks to achieve granular usage attribution for dbt pipelines. It explains how these tags are applied to queries executed by dbt, allowing for the association of compute and storage costs with specific dbt models or jobs. The technical details likely involve how Databricks' query engine processes and reports on these tags, and how this data is integrated into the Lakebase system for billing and analysis.

More from the Lakebase trail