Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to make request! #50

Open
Dragonizedpizza opened this issue Nov 15, 2022 · 7 comments
Open

Failed to make request! #50

Dragonizedpizza opened this issue Nov 15, 2022 · 7 comments

Comments

@Dragonizedpizza
Copy link

import os
from twitter_scraper_selenium import scrape_topic_with_api

scrape_topic_with_api(URL='https://twitter.com/i/topics/1468157909318045697', output_filename='tweets', tweets_count=10, headless=False)

if os.path.isfile("./tweets.json") == False:
    scrape_topic_with_api(URL='https://twitter.com/i/topics/1468157909318045697', output_filename='tweets', tweets_count=10, headless=False)

if len(open("./tweets.json").read()) < 100:
    scrape_topic_with_api(URL='https://twitter.com/i/topics/1468157909318045697', output_filename='tweets', tweets_count=10, headless=False)

I'm repeatedly getting the warning "Failed to make request!" even though I can see firefox opening and I can see the tweets.

@Dragonizedpizza
Copy link
Author

image

@shaikhsajid1111
Copy link
Owner

shaikhsajid1111 commented Nov 15, 2022

Alright, you're not getting any other logs from anywhere else?. Whenever any method fails it does logs something but for you it seems it is crashing silently

@Dragonizedpizza
Copy link
Author

Alright, you're not getting any other logs from anywhere else?. Whenever any method fails it does logs something but for you it seems it is crashing silently

its logging to geckodriver.log, https://pastebin.com/ng3wrU2E

@shaikhsajid1111
Copy link
Owner

I wonder if Twitter had changes in their services 😅. I'm currently unavailable to push a fix, it may take a week for me

@Dragonizedpizza
Copy link
Author

Dragonizedpizza commented Nov 23, 2022

I wonder if Twitter had changes in their services sweat_smile. I'm currently unavailable to push a fix, it may take a week for me

hi sajid, would it be possible to do it now? I need it up asap

@shaikhsajid1111
Copy link
Owner

Sorry, I'm not using my machine currently as I'm out of my hometown. I may be able to fix it for couple of weeks

@Dragonizedpizza
Copy link
Author

Sorry, I'm not using my machine currently as I'm out of my hometown. I may be able to fix it for couple of weeks

may or may not?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants