Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Suggestions for the get_full_article method. #36

Open
EliTheKnight opened this issue Jun 12, 2022 · 4 comments
Open

Suggestions for the get_full_article method. #36

EliTheKnight opened this issue Jun 12, 2022 · 4 comments

Comments

@EliTheKnight
Copy link

No description provided.

@EliTheKnight
Copy link
Author

EliTheKnight commented Jun 12, 2022

I added these lines to give it a user-agent and it helped, just thought you should know as it might be helpful in the future.
config = newspaper.Config()
config.browser_user_agent = USER_AGENT
article = newspaper.Article(url="%s" % url, language=self._language, config=config)

@EliTheKnight EliTheKnight changed the title I was having some trouble with the get_full_article method: I was having some trouble with the get_full_article method. Jun 12, 2022
@EliTheKnight EliTheKnight changed the title I was having some trouble with the get_full_article method. Suggestions for the get_full_article method. Jun 12, 2022
@EliTheKnight
Copy link
Author

I also think some of the user-agents are out of date as I get errors like:
Article download() failed with 400 Client Error: Bad Request for url
Article download() failed with 403 Client Error: Unsupported Browser for url

@rolandgvc
Copy link

I'm having the ERROR: Article download() failed with 403 Client Error: Max restarts limit reached for url errors too

@ranahaani
Copy link
Owner

I also think some of the user-agents are out of date as I get errors like: Article download() failed with 400 Client Error: Bad Request for url Article download() failed with 403 Client Error: Unsupported Browser for url

can you please list down all the outdated user-agents? or you can create PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants