[FEATURE REQUEST] Ollama compatibility

[jb-reefer]

It looks like there's a repo that gets close - https://github.com/anaisbetts/TypeChat/tree/main - but now that Ollama has OpenAI API compatibility, it would be great to have on-device LLMs supported.

I took a crack at it but couldn't hack it in an hour or so, so filing this.