Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add an AI-Proxy Wasm plugin #921

Merged
merged 28 commits into from May 14, 2024
Merged

Conversation

CH3CHO
Copy link
Collaborator

@CH3CHO CH3CHO commented Apr 23, 2024

Ⅰ. Describe what this PR did

Add an AI-Proxy Wasm plugin.

Support following AI service providers:

  1. OpenAI
  2. Azure OpenAI
  3. Moonshoot
  4. Qwen (streaming only for now)

Qwen streaming test with NextChat:
1

Ⅱ. Does this pull request fix one issue?

Ⅲ. Why don't you add test cases (unit test/integration test)?

Ⅳ. Describe how to verify it

Ⅴ. Special notes for reviews

@CH3CHO CH3CHO marked this pull request as draft April 23, 2024 02:26
@johnlanni johnlanni changed the title feat: Add an AI-Proxy Wasm plugin for POC feat: Add an AI-Proxy Wasm plugin May 7, 2024
@johnlanni johnlanni marked this pull request as ready for review May 7, 2024 06:45
plugins/wasm-go/extensions/ai-proxy/README.md Outdated Show resolved Hide resolved
plugins/wasm-go/extensions/ai-proxy/README.md Outdated Show resolved Hide resolved
plugins/wasm-go/extensions/ai-proxy/README.md Show resolved Hide resolved
plugins/wasm-go/extensions/ai-proxy/README.md Outdated Show resolved Hide resolved
plugins/wasm-go/extensions/ai-proxy/README.md Outdated Show resolved Hide resolved
plugins/wasm-go/extensions/ai-proxy/README.md Outdated Show resolved Hide resolved
return types.ActionContinue
}

func getApiName(path string) provider.ApiName {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个是不是应该放到provider实现中,如果provider是openai,应该要支持所有API,例如embedding等。

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

@CH3CHO CH3CHO requested a review from johnlanni May 10, 2024 01:25
Copy link
Collaborator

@johnlanni johnlanni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great Work!

@johnlanni johnlanni merged commit 333f9b4 into alibaba:main May 14, 2024
11 checks passed
@CH3CHO CH3CHO deleted the feat/ai-proxy-plugin branch May 14, 2024 14:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants