Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proxy Server configuration (HttpProxyMiddleware) #234

Open
bkrishnap opened this issue Aug 7, 2022 · 3 comments
Open

Proxy Server configuration (HttpProxyMiddleware) #234

bkrishnap opened this issue Aug 7, 2022 · 3 comments

Comments

@bkrishnap
Copy link

Is there a way we can configure the proxy server with news-please? I would like to add a proxy endpoint to hide the main IP of the server that is installed with news-please.

I tried to figure out where I can fit it with the HttpProxyMiddleware with the help of below documentation and I am not successful with the configs.

https://doc.scrapy.org/en/1.1/topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpproxy

@fhamborg
Copy link
Owner

did you check whether the requests library supports this?

@bkrishnap
Copy link
Author

requests does support. Something like this? But where should be entrypoint for this ..

`import requests

proxies = {
"http": "http://10.10.1.10:3128",
"https": "http://10.10.1.10:1080",
}

requests.get("http://example.org", proxies=proxies)`

@mcnamara-charles
Copy link

I'm curious about this as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants