Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request: Non-GUI version for Ubuntu - CLI #193

Open
XCHSystems opened this issue Dec 15, 2023 · 3 comments
Open

Request: Non-GUI version for Ubuntu - CLI #193

XCHSystems opened this issue Dec 15, 2023 · 3 comments

Comments

@XCHSystems
Copy link

Since most "Compute" deployments will be DC bound and headless, you need to incorporate a CLI version of Morpheus that does not require a GUI

All the GPU resources should be for the AI workload and not consumed by any GUI, most of our platforms go into datacenters where the only allowed access is SSH. Installing a GUI also screws with NVIDIA drivers and CUDA.

I'd also like to ask about other GPU Vendors, such as the Intel GPU MAX which uses C++, and also the new AI Accelerators on the 4th and 5th Gen XEONs (Advanced Matrix Extensions), which are much more efficient at inferencing than the GPU

@DavidAJohnston
Copy link
Contributor

Good suggestion. Love to see a pull request on this CLI version of Morpheus.

Morpheus should be agnostic to type of Compute used. Right now its everything that can use with Ollama.

@YashKumarVerma
Copy link

I'm interested in working on this. I strongly support the fact that there shouldn't be a need to setup an electron application in order to use the project, as electron comes with its benefits and tradeoffs.

@DavidAJohnston
Copy link
Contributor

How many hours of work to do you think this would take @YashKumarVerma ?
Seems worth doing, though maybe closer to when the Compute phase 2 is gearing up to go live in the coming months.
Also be sure to see the latest 0.0.6 version in Beta.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants