Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some URLs are not scraped #14

Open
Ro-Den opened this issue Apr 12, 2023 · 3 comments
Open

Some URLs are not scraped #14

Ro-Den opened this issue Apr 12, 2023 · 3 comments

Comments

@Ro-Den
Copy link

Ro-Den commented Apr 12, 2023

URLs with the following syntax are not scraped:

  1. .com/_ - don't know why, e.g. Umidigi F1. Maybe the scraper omits the part after / and downloads the main page.

  2. [g] - throws the following error: GuzzleHttp\Exception\TooManyRedirectsException. It's just one model: vivo Y20s [G]. I tried to change the URL to %5Bg%5D but to no avail.

P.S.: Glad you are back and with a cute website.

@ilyasozkurt
Copy link
Owner

Hello @Ro-Den,

Thank you for your feedback about my website.

Can you please share full URL with me that occurs this redirect loop?

@Ro-Den
Copy link
Author

Ro-Den commented Apr 18, 2023

@Ro-Den
Copy link
Author

Ro-Den commented May 20, 2023

The following has resolved the issues:

  1. trim($name);

What a great idea to terminate instructions with smilies ):

  1. I replaced Illuminate\Support\Facades\Http with curl 'cause Laravel's HTTP Client is too tricky to debug ):

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants