OpenAI API compatible HTTP server with GPT4-V and function call? #2377
Unanswered
Starlento
asked this question in
Self Hosting | 私有化部署
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I would like to know whether there is an existing repo/framework support hosting an open-source vlm as GPT4-V api.
And another question is related to functional call, seems lobe-chat depends on the server side to run the tool functions, is there any repo/framework can host certain functional call?
I checked vllm, ollama, llama.cpp,tgwebui, seems no certain functions.
Beta Was this translation helpful? Give feedback.
All reactions