Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow to set the base_url for the openai gateway #60

Closed
shuther opened this issue Mar 12, 2024 · 5 comments · Fixed by #64
Closed

Allow to set the base_url for the openai gateway #60

shuther opened this issue Mar 12, 2024 · 5 comments · Fixed by #64

Comments

@shuther
Copy link

shuther commented Mar 12, 2024

Add the ability to change the openai endpoint (baseURL) as per OpenAI SDK to be able to leverage self hosted LLM.

@ferrislucas
Copy link
Owner

@shuther thanks for opening this issue. Sorry for the slow response. Do you have any interest in creating a PR for this functionality? I think it would be great to support local models and additional providers.

@ferrislucas
Copy link
Owner

ferrislucas commented May 20, 2024

@keiththomps did you have any luck with this? It looks like you added the ability to specify a base url, did that work for you? I really appreciate your contribution.

main...keiththomps:promptr:main

@keiththomps
Copy link
Contributor

@ferrislucas I honestly can't remember 😅 I ended up dabbling with anthropic and spun up a completely different tool heavily inspired by promptr to do that. Let me pull my branch down and test it out with our proxy

@keiththomps
Copy link
Contributor

keiththomps commented May 20, 2024

Tested it using my work gateway and it works 👍 #64 Sorry for not adding a test.

@ferrislucas
Copy link
Owner

Thank you very much for the PR and your time @keiththomps !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants