Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AMD ROCm support with HIPBLAS #415

Open
xangelix opened this issue Aug 27, 2023 · 2 comments
Open

AMD ROCm support with HIPBLAS #415

xangelix opened this issue Aug 27, 2023 · 2 comments

Comments

@xangelix
Copy link

ggerganov/llama.cpp#1087 was merged recently and should make its way into GGML shortly. I think (hopefully) it should require only minimal changes on this side.
@xangelix
Copy link
Author

related to ggerganov/ggml#472

@LLukas22
Copy link
Contributor

rustformers uses llama.cpp as it's ggml source, feel free to create an PR including this change, seams like you only need to adjust the build.rs of the ggml-sys create. I wont be able to test this as i don't own a amd gpu.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@xangelix @LLukas22