Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add cargo install method to installation documentation #2032

Open
nuke-web3 opened this issue May 2, 2024 · 5 comments
Open

Add cargo install method to installation documentation #2032

nuke-web3 opened this issue May 2, 2024 · 5 comments

Comments

@nuke-web3
Copy link
Contributor

I see that it's possible to run locally without needing docker or homebrew etc. for those using the Rust toolchain natively:

tabby/CONTRIBUTING.md

Lines 48 to 54 in b71f9c5

## Building and Running
Tabby can be run through `cargo` in much the same manner as docker:
```
cargo run serve --model TabbyML/StarCoder-1B
```

Would https://tabby.tabbyml.com/docs/installation/ be open to a PR that echos the CONTRIBUTING doc on how to install and run directly? Or is there something more nuanced about how the binary / container is shipped that doing this would miss?

@nuke-web3
Copy link
Contributor Author

Also maybe a minor nit: I see it's suggested to use cargo run in debud more, not cargo run --release - is that intentional?

@wsxiaoys
Copy link
Member

wsxiaoys commented May 2, 2024

The CONTRIBUTING.md file serves as a guide for those interested in contributing to the development of Tabby. It is not intended for general users who wish to deploy or run Tabby on their infrastructure.

The container and binary are distributed at the following locations:

@nuke-web3
Copy link
Contributor Author

It is not intended for general users who wish to deploy or run Tabby on their infrastructure.

Is there a specific reason why? As my intended use is to run and use the service only on a single device, and would much rather have a compiled from source version to do that than a bin/container. With #2035 I can get this running in --release mode just fine, TBD soon if the API exposed at the default 0.0.0.0:8080 is working correctly.

@wsxiaoys
Copy link
Member

wsxiaoys commented May 3, 2024

for local use case, why not just using the binary distribution / docker distribution linked above?

@nuke-web3
Copy link
Contributor Author

I do not run untrusted binary distributions whenever possible. As I mentioned I want to build from source. Especially when it's a cargo project that makes it very easy! 😁 (Minus the require intalled deps as I ran into here 😅 )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants