Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: broken create_job method #300

Merged
merged 13 commits into from Oct 20, 2020
Merged

fix: broken create_job method #300

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
f305f04
fix: broken create_job method
HemangChothani Oct 6, 2020
f98950a
Merge branch 'master' of https://github.com/googleapis/python-bigquer…
HemangChothani Oct 7, 2020
38ce75e
fix: changes in unit tests
HemangChothani Oct 7, 2020
8a27c7c
Merge branch 'master' of https://github.com/googleapis/python-bigquer…
HemangChothani Oct 8, 2020
14bbe01
fix: fix sourceTable thing
HemangChothani Oct 12, 2020
64549c4
Merge branch 'master' of https://github.com/googleapis/python-bigquer…
HemangChothani Oct 12, 2020
f94998f
fix: handle sourceTable passed in job resource
HemangChothani Oct 13, 2020
d8b9e77
Merge branch 'master' of https://github.com/googleapis/python-bigquer…
HemangChothani Oct 13, 2020
b578c90
fix: resolve conflict and address comments
HemangChothani Oct 16, 2020
e130f9a
fix: remove delete destination table from query
HemangChothani Oct 19, 2020
5c7a39b
Merge branch 'master' of https://github.com/googleapis/python-bigquer…
HemangChothani Oct 19, 2020
4223b78
fix: revert destination table for query
HemangChothani Oct 19, 2020
104294a
Merge branch 'master' of https://github.com/googleapis/python-bigquer…
HemangChothani Oct 19, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
12 changes: 7 additions & 5 deletions google/cloud/bigquery/client.py
View file
Open in desktop
Expand Up @@ -1617,6 +1617,7 @@ def create_job(self, job_config, retry=DEFAULT_RETRY):
)
destination = _get_sub_prop(job_config, ["load", "destinationTable"])
source_uris = _get_sub_prop(job_config, ["load", "sourceUris"])
destination = TableReference.from_api_repr(destination)
return self.load_table_from_uri(
source_uris, destination, job_config=load_job_config, retry=retry
)
Expand All @@ -1625,11 +1626,9 @@ def create_job(self, job_config, retry=DEFAULT_RETRY):
job_config
)
destination = _get_sub_prop(job_config, ["copy", "destinationTable"])
destination = TableReference.from_api_repr(destination)
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would you like to guard this check with isinstance(TableReference, destination)?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I mock further in test so now it cover to_api_repr. I am not sure about the guard to check instance because job_config is dict and as per the example it has values in the string format.

sources = []
source_configs = _get_sub_prop(job_config, ["copy", "sourceTables"])

if source_configs is None:
source_configs = [_get_sub_prop(job_config, ["copy", "sourceTable"])]
tswast marked this conversation as resolved.
Show resolved Hide resolved
for source_config in source_configs:
table_ref = TableReference.from_api_repr(source_config)
sources.append(table_ref)
Expand All @@ -1641,10 +1640,13 @@ def create_job(self, job_config, retry=DEFAULT_RETRY):
job_config
)
source = _get_sub_prop(job_config, ["extract", "sourceTable"])
source_type = "Table"
if not source:
if source:
source_type = "Table"
source = TableReference.from_api_repr(source)
else:
source = _get_sub_prop(job_config, ["extract", "sourceModel"])
source_type = "Model"
source = ModelReference.from_api_repr(source)
destination_uris = _get_sub_prop(job_config, ["extract", "destinationUris"])
return self.extract_table(
source,
Expand Down
20 changes: 0 additions & 20 deletions tests/unit/test_client.py
View file
Open in desktop
Expand Up @@ -3631,26 +3631,6 @@ def test_create_job_copy_config(self):
configuration, "google.cloud.bigquery.client.Client.copy_table",
)

def test_create_job_copy_config_w_single_source(self):
tswast marked this conversation as resolved.
Show resolved Hide resolved
configuration = {
"copy": {
"sourceTable": {
"projectId": self.PROJECT,
"datasetId": self.DS_ID,
"tableId": "source_table",
},
"destinationTable": {
"projectId": self.PROJECT,
"datasetId": self.DS_ID,
"tableId": "destination_table",
},
}
}

self._create_job_helper(
configuration, "google.cloud.bigquery.client.Client.copy_table",
)

def test_create_job_extract_config(self):
configuration = {
"extract": {
Expand Down