Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

prefect-dbt: from_file method for BigQueryTargetConfigs #13399

Open
3 tasks done
robfreedy opened this issue May 16, 2024 · 0 comments
Open
3 tasks done

prefect-dbt: from_file method for BigQueryTargetConfigs #13399

robfreedy opened this issue May 16, 2024 · 0 comments
Labels
enhancement An improvement of an existing feature integrations Related to integrations with other services

Comments

@robfreedy
Copy link
Contributor

robfreedy commented May 16, 2024

First check

  • I added a descriptive title to this issue.
  • I used the GitHub search to find a similar request and didn't find it.
  • I searched the Prefect documentation for this feature.

Prefect Version

2.x

Describe the current behavior

Currently, you have to define a BigQueryTargetConfigs block with BigQuery configurations manually in python code or in the Prefect UI, which can then get passed to the DbtCliProfile to save the credentials. This usually means a lot of copying and pasting from the dbt profiles.yml or elsewhere.

Describe the proposed behavior

Add a from_file method to the BigQueryTargetConfigs block to automatically populate the credentials and config into a new instance of a BigQueryTargetConfigs block given an existing dbt profiles.yml file.

Example Use

big_query_target_configs = BigQueryTargetConfigs.from_file(file_path="/path/to/profileyaml/.dbt/profile.yml")
dbt_cli_profile = DbtCliProfile(
            name="jaffle_shop",
            target="dev",
            target_configs=big_query_target_configs,
        )

Additional context

No response

@robfreedy robfreedy added enhancement An improvement of an existing feature needs:triage Needs feedback from the Prefect product team integrations Related to integrations with other services and removed needs:triage Needs feedback from the Prefect product team labels May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement An improvement of an existing feature integrations Related to integrations with other services
Projects
None yet
Development

No branches or pull requests

1 participant