Skip to content
This repository has been archived by the owner on Mar 17, 2023. It is now read-only.

craigslist blocks digitalocean IPs #9

Open
jonpolak opened this issue Aug 31, 2016 · 3 comments
Open

craigslist blocks digitalocean IPs #9

jonpolak opened this issue Aug 31, 2016 · 3 comments

Comments

@jonpolak
Copy link

See this HN discussion: https://news.ycombinator.com/item?id=6285746

@github-bdem
Copy link

nope, my digital ocean vps works just fine.

@ChrisRenfrow
Copy link

I know this is an old issue but I can confirm that CL will auto-block after a while, ran for about 3 days before getting 403'd. Gonna have to figure out some sort of rotating VPN solution perhaps.

$ curl https://www.craigslist.org/about/sites
This IP has been automatically blocked.
If you have questions, please email: blocks-[REDACTED]@craigslist.org

@AndriusCTR
Copy link

AndriusCTR commented Sep 13, 2020

I know this is an old issue but I can confirm that CL will auto-block after a while, ran for about 3 days before getting 403'd. Gonna have to figure out some sort of rotating VPN solution perhaps.

$ curl https://www.craigslist.org/about/sites
This IP has been automatically blocked.
If you have questions, please email: blocks-[REDACTED]@craigslist.org

You know what's funny, I tried wget from DO vps and it works, but if I curl (from PHP) it gets blocked, even if I use all browser's headers 1:1. Can't figure out why this is happening (wget url returns 200 status while curl 403)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants