Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fresh Install - API Never Starts #134

Open
f2pc opened this issue Dec 10, 2023 · 1 comment
Open

Fresh Install - API Never Starts #134

f2pc opened this issue Dec 10, 2023 · 1 comment

Comments

@f2pc
Copy link

f2pc commented Dec 10, 2023

"llama-gpt_llama-gpt-api_1" Never starts on a fresh install of Umbrel v.5.4.0.

Here are the logs:
`llama-gpt

Attaching to llama-gpt_llama-gpt-api_1, llama-gpt_llama-gpt-ui_1, llama-gpt_app_proxy_1
app_proxy_1 | yarn run v1.22.19
app_proxy_1 | $ node ./bin/www
app_proxy_1 | [HPM] Proxy created: / -> http://llama-gpt-ui:3000
app_proxy_1 | Waiting for llama-gpt-ui:3000 to open...
llama-gpt-api_1 | File "", line 189, in _run_module_as_main
llama-gpt-api_1 | File "", line 112, in _get_module_details
llama-gpt-api_1 | File "/app/llama_cpp/init.py", line 1, in
llama-gpt-api_1 | from .llama_cpp import *
llama-gpt-api_1 | File "/app/llama_cpp/llama_cpp.py", line 80, in
llama-gpt-api_1 | _lib = _load_shared_library(_lib_base_name)
llama-gpt-api_1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llama-gpt-api_1 | File "/app/llama_cpp/llama_cpp.py", line 71, in _load_shared_library
llama-gpt-api_1 | raise FileNotFoundError(
llama-gpt-api_1 | FileNotFoundError: Shared library with base name 'llama' not found
llama-gpt-ui_1 | [INFO wait] Host [llama-gpt-api:8000] not yet available...`

System Information:

  • VirtualBox Ubuntu Image (fresh install)
  • 12 cores dedicated to the VM
  • 24GB RAM dedicated to the VM
  • 90GB Virtual Drive (SSD)
  • Physical CPU: AMD Ryzen 9 3900X
  • Physical Memory: 24GB
  • Trying to use the 13B model

I have looked at the other issues and mine is similar but docker-compose up and some of the other suggestions do not work.

Logs - umbrel-1702211544820-debug(1).log

@f2pc f2pc changed the title Fresh Install - Llama_gpt Fresh Install - API Never Starts Dec 10, 2023
@f2pc
Copy link
Author

f2pc commented Dec 12, 2023

Blew the VM away, same exact issue.
logs - umbrel

Where is '/app/llama_cpp/llama_cpp.py' supposed to be?
image

Both directories have llama_ccp.py:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant