downloading/archiving a twitter account with a large amount of retweets/posts? #5486
Unanswered
infinitephantasm
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
i have a twitter account with a vast amount of tweets/retweets made to it (~16000) -- i've done the usual for grabbing images; add the cookie, specify the main page, deal with rate limiting, all that. but, for some reason, it only makes it to a few weeks or so of posts before it starts skipping several months & years, before eventually stopping entirely.
restarting the process will just go over the same tweets, which is not ideal since it wastes the rate limit more, and results in time that could be spent grabbing other tweets, although i assume there's not much to be done about that.
there's a lot of history over the years on it, mostly in the form of art, that i would rather get archived before the website kicks the bucket or content gets censored. is there anything i can do to grab the large amount of missing posts, or am i just screwed by twitter's own garbage limits?
if the account is needed for further information, here (note: it is very NSFW)
and here's the config i currently have, for good measure:
Beta Was this translation helpful? Give feedback.
All reactions