Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancement: Per-endpoint proxy setting #2776

Open
1 task done
like-a-freedom opened this issue May 18, 2024 · 1 comment
Open
1 task done

Enhancement: Per-endpoint proxy setting #2776

like-a-freedom opened this issue May 18, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@like-a-freedom
Copy link

What features would you like to see added?

Wondering to add ability to set up proxy per-endpoint, not only globally for all endpoints.

More details

Cause when I'm setting proxy: it is works only globally, but in case if you (like me) have external integration that should work through the proxy and local llm (like ollama or/and local lite-llm that I wouldn't publish to internet) the local ones wouldn't work (apparently cause it'll be connection refuse).

Which components are impacted by your request?

Endpoints

Pictures

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@like-a-freedom like-a-freedom added the enhancement New feature or request label May 18, 2024
@danny-avila
Copy link
Owner

sounds good, should be easily implemented

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants