Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Impossible to upload my dataset because your server is ALWAYS resetting connections before end of upload ! #2514

Open
jarredou opened this issue Dec 7, 2023 · 4 comments
Labels

Comments

@jarredou
Copy link

jarredou commented Dec 7, 2023

Impossible to share my dataset with the community because your server is ALWAYS resetting connection before end upload.
UI and API are failing the same way.

Traceback (most recent call last):
  File "D:\!Dev\zenodo.py", line 42, in <module>
    r = requests.put(
  File "C:\Program Files\Python38\lib\site-packages\requests\api.py", line 130, in put
    return request("put", url, data=data, **kwargs)
  File "C:\Program Files\Python38\lib\site-packages\requests\api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "C:\Program Files\Python38\lib\site-packages\requests\sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "C:\Program Files\Python38\lib\site-packages\requests\sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "C:\Program Files\Python38\lib\site-packages\requests\adapters.py", line 547, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(10054, 'Une connexion existante a dû être fermée par l’hôte distant', None, 10054, None))
@jarredou jarredou added the Bug label Dec 7, 2023
@carlinmack
Copy link

Very sorry to hear you are having problems, What is the size of your upload? We are seeing users having difficulties with archives greater than 8GB

@mjfos2r
Copy link

mjfos2r commented Feb 6, 2024

to add to this, I am also struggling to download large datasets due to the same connection issue. My file is 40gb.

@Raen111
Copy link

Raen111 commented Feb 7, 2024

> to add to this, I am also struggling to download large datasets due to the same connection issue. My file is 40gb.

@fburic
Copy link

fburic commented Feb 29, 2024

I believe this is some sort of timeout issue.

I was experiencing upload errors using the Web interface with a 9.2 GB file (on Firefox 122, NetworkError without details in the Javascript console after the progress bar turned red).

My upload speed was 10 Mbps and the upload would halt at about 30-50%, after 40-50? minutes.
I switched to a 100 Mbps upload plan and the upload finished without a problem and of course, at a much higher speed. I didn't time it but it felt like x10 increase, as expected (was done in ~15 min), meaning I likely haven't hit whatever upload limit Zenodo has.

So it seems to me that the time needed for uploading might be the factor setting off the connection resets.
I naturally cannot account for Zenodo server load, so no idea how that plays into it. The upload speed on the 10 Mbps connection wasn't constant between attempts.

Hope this helps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants