huggingface Inference API Endpoint zephyr-7b-beta #598
Closed
quantumalchemy
started this conversation in
Integrations
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Any integration plan for using the huggingface Inference API Endpoint for zephyr-7b-beta ?
ie: api-inference.huggingface.co/models/HuggingFaceH4/zephyr-7b-beta
or did I miss something?
maybe using openai wrapper like: litellm
https://github.com/BerriAI/litellm
I guess it would depend on the api returning the function calling requirements Any insight?
Beta Was this translation helpful? Give feedback.
All reactions