Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload retry support (to mirror download retry behavior) #90

Open
lsowen opened this issue Jul 12, 2017 · 3 comments
Open

Upload retry support (to mirror download retry behavior) #90

lsowen opened this issue Jul 12, 2017 · 3 comments

Comments

@lsowen
Copy link

lsowen commented Jul 12, 2017

S3Transfer (and thus boto3) has the num_download_attempts, which handles retries for issues like socket.timeout, socket.error, etc.

It would be greatly helpful if a similar option as added (and exposed up through boto3) for the upload direct.

@stealthycoin
Copy link
Contributor

Marking as a feature request.

@nirmalyamisra
Copy link

Is this implemented?
What is the default no of retry attempts internally for upload?

@elyscape
Copy link

This would be particularly helpful for multipart uploads, where one chunk might fail towards the end of a potentially very large upload. With the current behavior, the transfer aborts and the entire file has to be reuploaded. Ideally, the library would retry the failed chunk(s) and proceed with other chunks until it hit a failure threshold for any given chunk.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants