Add Android support

[amakropoulos]

Purpose of this features is to add support of LLMUnity for Android

Issues:

• llamafile does not support Android, the llama.cpp server binary will need to be separately compiled
• Android needs separate implementation for starting and possibly communicating to the server

An experimental WIP branch is feature/android_support

[al3dv2]

Yes please add android that would be awesome !

[al3dv2]

I don't see the experimental branch, where I can download it ? thanks "feature/android_support"

[amakropoulos]

Ah I was trying something but deleted it, didn't really progress.

[al3dv2]

Oh ok do you thinks it's possible to have unity LLM on android ? thks

[amakropoulos]

At some point, but I think it's going to need implementation effort

[yumianhuli2]

At some point, but I think it's going to need implementation effort

Hello! Do you have this plan for android support?

[amakropoulos]

Yes! I'm actually doing some tests right now, but can't yet promise on dates

[yumianhuli2]

Yes! I'm actually doing some tests right now, but can't yet promise on dates

Oh, thanks my God

[ropenrom24]

Hi @amakropoulos can you give us the high level stuff on how would you implemented this? I see that your using a process to start a server from llamafile-0.6.2.exe which is from this repository. But how would this be implemented on android? thanks.

[amakropoulos]

Sure, this feature will be built after #141 which will replace llamafile with directly integrated DLLs.
Android is supported by llama.cpp so after that I'll build a DLL specific for Android to serve the functionality.
And then fingers crossed :)!