-
Notifications
You must be signed in to change notification settings - Fork 599
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Get_tweets gives the same page #101
Comments
Yes, look like scrolling mechanism not working on hashtag pages. >>> liste = []
... from twitter_scraper import get_tweets
... for tweet in get_tweets('#mock', 3):
... liste.append(tweet['tweetId'])
>>> liste.count(liste[0])
3 # first tweet's id repeats 3 times in our scraped tweets
>>> liste = []
... from twitter_scraper import get_tweets
... for tweet in get_tweets('bugraisguzar', 3):
... liste.append(tweet['tweetId'])
>>> liste.count(liste[0])
1 # first tweet's id is uniq as it should be We will work on it, help needed |
Got the same error. Does it have to do with the way it's queried and the resulting URL? maybe the pagination works different from User profiles to Hashtags? |
First at all, thanks. Looks like "max_position" parameter not supported for hashtag pages. I couldn't search it yet. Helps are welcome! |
did anyone have any progress? stuck at the same issue :/ |
Finally got it to work! See changes in #150 Brief summary of how I fixed it by modifying Change
Change This gets rid of twitter pages repeating on search query. |
Would this pagination method in search applicable to digging all tweets from a user? |
So, I checked get_tweets function with default pages arg 25 and different hashtags. And as output, I got just 25 same pages of tweets. I did this:
When I define the number of pages, it doesn't really change anything.
The text was updated successfully, but these errors were encountered: