Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hitting 1000 jobs selection limit #31

Open
romainfd opened this issue Jun 7, 2022 · 5 comments
Open

Hitting 1000 jobs selection limit #31

romainfd opened this issue Jun 7, 2022 · 5 comments

Comments

@romainfd
Copy link

romainfd commented Jun 7, 2022

Hello,
I am hitting a 1000 offers limit per request on indeed side (with limit=0 in the config). They seem to not provide any new offer after this limit.
Do you have any idea on how to overcome this limit?
Many thanks for this cool package!

@frizurd
Copy link

frizurd commented Jul 4, 2022

Were you able to overcome this limit?

@romainfd
Copy link
Author

romainfd commented Jul 4, 2022

Sadly no, do you have any idea?

@zikyfranky
Copy link

I haven't tested out the library, according to package.json, the request library is being used to query the host.

I'd check if it's possible to add a proxy to the request call, that way we should be able to bypass the limits

@zikyfranky
Copy link

I just came across this SO answer, requesting with proxy/user-agent is possible.

I do not know when I'd have time to go over this(testing), but if anyone else sees this, feel free to send a PR.

@zikyfranky
Copy link

I tried running it, but unfortunately, indeed doesn't accept visits from Javascript disabled browsers, so there's no way to test it out.

Would have to substitute request with something else

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants