You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I guess development here is no more -- but making this async would be really good/functional. Trying to backup a site with 175k links for example, I'm on URL 80 after a minute. Not really feasible.... I'm going to do something in python but it will be very basic and not a really great CLI like this.
The text was updated successfully, but these errors were encountered:
mpr1255
changed the title
Make it async?
Make it async? [feature request]
Jun 19, 2023
A side note: the internet archive has implemented a rate limit feature which probably breaks all mutli-threaded downloads, like -c, since it breaks single threaded downloading as well without substantial delays between requests. See pull request #268 and #266 for more details
I guess development here is no more -- but making this async would be really good/functional. Trying to backup a site with 175k links for example, I'm on URL 80 after a minute. Not really feasible.... I'm going to do something in python but it will be very basic and not a really great CLI like this.
The text was updated successfully, but these errors were encountered: