Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Request] 支持多个 oneapi 同时存在 #2253

Open
sxjeru opened this issue Apr 28, 2024 · 11 comments
Open

[Request] 支持多个 oneapi 同时存在 #2253

sxjeru opened this issue Apr 28, 2024 · 11 comments
Labels
🌠 Feature Request New feature or request | 特性与建议

Comments

@sxjeru
Copy link
Contributor

sxjeru commented Apr 28, 2024

🥰 需求描述

已知存在兼容 OpenAI API 的 oneapi,希望能实现多 oneapi 共存。

为了避免与 OpenAI 产生不必要的混淆,另可单独出一个 oneapi 区域。

每个 API 均能单独设置 Key、接口地址、模型。
若存在模型重复,可以考虑简单报错,或者负载均衡。

🧐 解决方案

见上。

📝 补充信息

No response

@sxjeru sxjeru added the 🌠 Feature Request New feature or request | 特性与建议 label Apr 28, 2024
@lobehubbot
Copy link
Member

👀 @sxjeru

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事,并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


🥰 Description of requirements

It is known that there is oneapi that is compatible with OpenAI API, and it is hoped that multiple oneapi can coexist.

In order to avoid unnecessary confusion with OpenAI, a separate oneapi area can be created.

Each API can set Key, interface address, and model independently.
If there are duplicate models, you can consider simple error reporting or load balancing.

🧐 Solution

See above.

📝 Supplementary information

No response

@sxjeru
Copy link
Contributor Author

sxjeru commented May 1, 2024

相关 #1985

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Related #1985

@arvinxx
Copy link
Contributor

arvinxx commented May 3, 2024

#2040 中支持

@ckt1031
Copy link

ckt1031 commented May 3, 2024

我覺得大可不必, 你自己部署一個OneAPI中繼所有OneAPI/OpenAI API就行了

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


I don’t think it’s necessary. Just deploy a OneAPI to relay all OneAPI/OpenAI APIs yourself.

@sxjeru
Copy link
Contributor Author

sxjeru commented May 3, 2024

我覺得大可不必, 你自己部署一個OneAPI中繼所有OneAPI/OpenAI API就行了

感谢提供另外的解决方案,各有优缺点可言。

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


I don’t think it’s necessary. Just deploy a OneAPI to relay all OneAPI/OpenAI APIs.

Thanks for the other solutions, each has its pros and cons.

@arvinxx
Copy link
Contributor

arvinxx commented May 3, 2024

@ckt1031 不考虑 oneapi,仅考虑提供允许添加自定义的 OpenAI 兼容 API 对于很多场景来说会有比较好的灵活度。例如某些小的Provider 只要兼容 openai 的接口规范,用户就可以将这个 provider 添加到自己的配置中

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


@ckt1031 Do not consider oneapi, only consider providing an OpenAI compatible API that allows adding customization, which will have better flexibility for many scenarios. For example, as long as some small providers are compatible with openai's interface specifications, users can add this provider to their own configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🌠 Feature Request New feature or request | 特性与建议
Projects
None yet
Development

No branches or pull requests

4 participants