Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scrape can't get anything #165

Open
G-walk opened this issue May 7, 2023 · 8 comments
Open

Scrape can't get anything #165

G-walk opened this issue May 7, 2023 · 8 comments

Comments

@G-walk
Copy link

G-walk commented May 7, 2023

I made the same modification as issue #163, now the scrape can search but can't return anything... Is it my problem or Twitter's?

ps: It worked well just 2 days ago.

image

@G-walk G-walk changed the title Scrape don't get anything Scrape can't get anything May 7, 2023
@yisyed
Copy link

yisyed commented May 7, 2023

I have faced the same issue. I modified scweet.py a bit, and it works. the solution is present in #163

@yisyed
Copy link

yisyed commented May 7, 2023

#163 (comment)

@G-walk
Copy link
Author

G-walk commented May 7, 2023

Thank you for your reply. I have actually seen your solution in #163, althougth I tried the solution by another user NicerWang instead of your's. It worked well for me two days ago, but today it just can't get anything. I think I have solved the login problem and the issue I meet now is something else.

I will try your method later, but just to make sure, your Scweet still works well now, right?

@yisyed
Copy link

yisyed commented May 7, 2023

My code still works.
One solution to figure out what's going on is to try 'headless = False'. This will show you what your code is doing in the background.
data = scrape(..., headless=False)

@G-walk
Copy link
Author

G-walk commented May 7, 2023

I use your method and find what the true issue is. I used my own Twitter account to log in, and Twitter recognized my account as suspicious. After the code input my email, password and user name, Twitter asked to input a confirmation code. Scweet of course can't do that. This is the true reason why I can't get anything.

I may type in the confirmation code manually, but the log in proccess is too fast that I can't do that... Anyway, thank you very much. It's glad to know Scweet still works : )

@yisyed
Copy link

yisyed commented May 7, 2023

Make a burner account for such activities and remove 2FA.
You cannot enter confirmation code or have any type of controll on the browser as the browser is controlled by the code (robot).

@YGH16
Copy link

YGH16 commented May 30, 2023

I made the same modification as issue #163, now the scrape can search but can't return anything... Is it my problem or Twitter's?

ps: It worked well just 2 days ago.

image

I had the same issue but managed to find a fix and posted it over over at #167

@baqachadil
Copy link

check the solution I provided in #169 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants