PulseAugur
EN
LIVE 05:04:16

Databricks introduces Query Tags for dbt pipeline cost attribution

Databricks has introduced Query Tags, a new feature in public preview that allows data teams to gain granular insights into dbt pipeline usage. This feature automatically injects metadata like dbt model names and enables users to add custom tags for cost centers, teams, and environments. These tags are recorded in `system.query.history`, facilitating cost attribution, performance debugging, and workload monitoring through simple SQL queries or by using Databricks' Genie assistant. AI

IMPACT Enhances data pipeline observability and cost management, crucial for optimizing AI/ML workloads.

RANK_REASON This is a product feature release for a data platform, not a frontier model release or significant industry event.

Read on Databricks Blog →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Databricks introduces Query Tags for dbt pipeline cost attribution

COVERAGE [1]

  1. Databricks Blog TIER_1 English(EN) ·

    Granular Usage Attribution for dbt Pipelines with Query Tags

    Your dbt project runs 80 models every night. The warehouse bill doubled last quarter....