You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Great piece of software @d42me! It'd be pretty easy to code the two main LLM entry points to allow a range of interfaces instead of just OpenAI. In particular, using ollama would open the whole system up to effectively unrestricted model choice. The completions of ollama are perfectly compatible with openai, and from what I can see of your models.py, the code should need only minimal modification. The embeddings in your vectordb.py would also need minimal modification to use ollama embeddings.
The biggest advantage would be the ability to use unlimited numbers of simulations, as everything would be local and free of additional API costs. Thoughts?
The text was updated successfully, but these errors were encountered:
Great piece of software @d42me! It'd be pretty easy to code the two main LLM entry points to allow a range of interfaces instead of just OpenAI. In particular, using ollama would open the whole system up to effectively unrestricted model choice. The completions of ollama are perfectly compatible with openai, and from what I can see of your
models.py
, the code should need only minimal modification. The embeddings in yourvectordb.py
would also need minimal modification to use ollama embeddings.The biggest advantage would be the ability to use unlimited numbers of simulations, as everything would be local and free of additional API costs. Thoughts?
The text was updated successfully, but these errors were encountered: