Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure Open AI Support #148

Open
bhctest123 opened this issue Sep 2, 2023 · 1 comment
Open

Azure Open AI Support #148

bhctest123 opened this issue Sep 2, 2023 · 1 comment

Comments

@bhctest123
Copy link

bhctest123 commented Sep 2, 2023

@YoBulkMaster @Shriansh2002

Your product is amazing, and its utility for high security and compliance scenarios is awesome because its self-hosted.

That being said you are limited currently in the AI side to only using Open AI directly which is not a compliant solution. Azure Open AI offers a secure and safe version of the same API but has a few configuration differences.

here is the information for your CTO / Engineers on how to use the Azure OpenAI Endpoints
Deployment Name - Enter your Deployment Name here
API Endpoint URL - Enter your API Endpoint, eg: https://example.openai.azure.com/
API Key - Enter your API key here
Base Model - Please select

Alternatively you could use this to have support for many LLM's https://github.com/BerriAI/litellm

@ishaan-jaff
Copy link

it looks like this repo is in JS - but happy to help out ! - as of now litellm only supports python

You can also use our proxy server if that makes sense

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants