Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support mobile User-Agents and the ability to switch between desktop/mobile #160

Open
Stealthmate opened this issue May 17, 2019 · 1 comment

Comments

@Stealthmate
Copy link

Hello,

Expected Behavior

Generally, when scraping one would want to use the mobile version of a website since it is smaller and and thus saves on both speed and network traffic. However, sometimes you have information that is only available on desktop (or mobile) and so you want to switch. Therefore it would be nice if Scrapoxy allowed the user to specify what type of UA to use (via a header or something).

Actual Behavior

Scrapoxy just gets a random UA from a list.

  • Version of Scrapoxy: 3.1.1

I checked the code and this seems fairly trivial to implement. Since I need this feature, I'm going to fork and implement it, so I can make a PR later as well :)

Thanks,
Stealthmate

@fabienvauchelles
Copy link
Owner

Good idea for the next version

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants