You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Dbt allow you to tag your models, and you can also tag your tables and views in Databricks. There should be a way to apply dbt tags to the tables and views in Databricks.
Alternative
I have considered implementing a custom solution using:
@AliAl-Gburi this is something we are thinking about as well. I think where things are a little complicated is that some dbt tags are strictly for dbt operations (e.g. I tag some tables with 'daily' for scheduling daily runs), but maybe it doesn't matter if those get synced to Databricks.
What are your thoughts on tags in Databricks that are not found in the dbt project? Specifically, how can a dbt project indicate that it wants to remove a tag? We have a similar issue with materialized views, where a tblproperty gets set by Databricks and we have to figure out the meaning of the absence of that tblproperty in the dbt project.
Hey @benc-db, thanks for the answer :D. For those who want dbt tags to remain in dbt and not overwrite whatever tags they've set in Databricks, the option to sync tags can be turned off.
I suppose "syncing" was not the correct term to use here. The idea is to have dbt tags be your single source of truth and then Databricks tables and views would match the tags defined in dbt.
Description
Dbt allow you to tag your models, and you can also tag your tables and views in Databricks. There should be a way to apply dbt tags to the tables and views in Databricks.
Alternative
I have considered implementing a custom solution using:
Benefits
This is useful for filtering the tables in databricks.
I would like to contribute in creating a seamless syncing process.
The text was updated successfully, but these errors were encountered: