Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: pass retry from Job.result() to Job.done() #41

Merged
merged 16 commits into from Nov 3, 2020

Conversation

IlyaFaer
Copy link

@IlyaFaer IlyaFaer commented Feb 21, 2020

Closes #24

@googlebot googlebot added the cla: yes This human has signed the Contributor License Agreement. label Feb 21, 2020
@IlyaFaer IlyaFaer changed the title feat(bigquery): pass retry from Job.result() to Job.done(). feat(bigquery): pass retry from Job.result() to Job.done() Feb 21, 2020
@IlyaFaer IlyaFaer added the do not merge Indicates a pull request not ready for merge, due to either quality or timing. label Feb 21, 2020
@IlyaFaer
Copy link
Author

This PR is strictly connected to googleapis/python-api-core#9, and should not be merged before №9

@IlyaFaer
Copy link
Author

Here is how it's gonna be passed into done()

image

@tseaver tseaver changed the title feat(bigquery): pass retry from Job.result() to Job.done() feat: pass retry from Job.result() to Job.done() Jul 30, 2020
@busunkim96 busunkim96 closed this Jul 31, 2020
@busunkim96 busunkim96 reopened this Jul 31, 2020
@tswast
Copy link
Contributor

tswast commented Oct 20, 2020

This will need to be updated to set the minimum api-core version in setup.py to 1.23.0 after googleapis/python-api-core#96 is released.

@tswast
Copy link
Contributor

tswast commented Oct 21, 2020

1.23.0 has been released. Work can continue on this PR

@IlyaFaer IlyaFaer removed the do not merge Indicates a pull request not ready for merge, due to either quality or timing. label Oct 22, 2020
@IlyaFaer
Copy link
Author

IlyaFaer commented Oct 22, 2020

Only one error is appearing:

self = <google.cloud.bigquery.job._AsyncJob object at 0x7f1fc2f0eb70>

    def to_api_repr(self):
        """Generate a resource for the job."""
>       raise NotImplementedError("Abstract")
E       NotImplementedError: Abstract

Doesn't seem to be related.

@IlyaFaer IlyaFaer requested a review from tswast October 22, 2020 09:08
@IlyaFaer IlyaFaer marked this pull request as ready for review October 22, 2020 09:08
@IlyaFaer IlyaFaer requested a review from a team October 22, 2020 09:08
Copy link
Contributor

@tswast tswast left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing update to minimum versions.

google/cloud/bigquery/job.py Show resolved Hide resolved
@tswast
Copy link
Contributor

tswast commented Oct 23, 2020

Filed #339 to look into the test failure. I've assigned to myself, as it might be related to some refactoring I recently completed.

@IlyaFaer
Copy link
Author

I think, a lot of tests will fail. And in many tests we'll have to add one more arg. That's why I've added the kwargs pattern.

@tswast
Copy link
Contributor

tswast commented Oct 27, 2020

I think, a lot of tests will fail. And in many tests we'll have to add one more arg. That's why I've added the kwargs pattern.

Okay, that makes sense. So long as we have some tests that have a custom retry, I'm okay with only populating it when it's something other than the default.

Copy link
Contributor

@tswast tswast left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not seeing any tests that verify the retry behavior is working as expected.

I'd like to see the test update I suggested here: https://github.com/googleapis/python-bigquery/pull/340/files#r511017196

The QueryJob class overrides result(), so we'll need a test that does the same but for QueryJob specifically.

@google-cla
Copy link

google-cla bot commented Nov 2, 2020

All (the pull request submitter and all commit authors) CLAs are signed, but one or more commits were authored or co-authored by someone other than the pull request submitter.

We need to confirm that all authors are ok with their commits being contributed to this project. Please have them confirm that by leaving a comment that contains only @googlebot I consent. in this pull request.

Note to project maintainer: There may be cases where the author cannot leave a comment, or the comment is not properly detected as consent. In those cases, you can manually confirm consent of the commit author(s), and set the cla label to yes (if enabled on your project).

ℹ️ Googlers: Go here for more info.

@google-cla google-cla bot added cla: no This human has *not* signed the Contributor License Agreement. and removed cla: yes This human has signed the Contributor License Agreement. labels Nov 2, 2020
@HemangChothani
Copy link
Contributor

@googlebot I consent

@google-cla google-cla bot added cla: yes This human has signed the Contributor License Agreement. and removed cla: no This human has *not* signed the Contributor License Agreement. labels Nov 2, 2020
@IlyaFaer
Copy link
Author

IlyaFaer commented Nov 2, 2020

@tswast, sorry, I'm little bit besieged by tasks, not able to continue with this right now. @HemangChothani kindly agreed to take a look at this PR.

tests/unit/test_job.py Show resolved Hide resolved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla: yes This human has signed the Contributor License Agreement.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

BigQuery: add retry for query results iteration
5 participants