Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Support BigQueryToBigQueryOperator #86

Merged
merged 2 commits into from Jun 14, 2021
Merged

Conversation

adlersantos
Copy link
Member

@adlersantos adlersantos commented Jun 11, 2021

Description

Some upcoming datasets are directly fetched from another BQ table with no transforms or schema changes needed. This PR add support for the BigQueryToBigQueryOperator.

Checklist

Note: Delete items below that aren't applicable to your pull request.

  • Please merge this PR for me once it is approved.
  • If this PR adds or edits a feature, I have updated the README accordingly.
  • This PR is appropriately labeled.

@adlersantos adlersantos added the feature request New feature or request label Jun 11, 2021
@adlersantos adlersantos changed the title feat: Support BQ to BQ operator feat: Support BigQueryToBigQueryOperator Jun 11, 2021
@@ -16,6 +16,10 @@
"import": "from airflow.contrib.operators import bigquery_operator",
"class": "bigquery_operator.BigQueryOperator"
},
"BigQueryToBigQueryOperator": {
"import": "from airflow.contrib.operators import bigquery_to_bigquery",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This note to our future selves is that importing from airflow.providers is planned in the roadmap and that's why I'm okay with this PR importing from contrib right now

@leahecole leahecole merged commit fd26476 into main Jun 14, 2021
@leahecole leahecole deleted the bq-to-bq-operator branch June 14, 2021 22:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants