Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GGUF support #1209

Open
2 tasks
lutzroeder opened this issue Dec 31, 2023 · 0 comments
Open
2 tasks

GGUF support #1209

lutzroeder opened this issue Dec 31, 2023 · 0 comments
Labels
feature

Comments

@lutzroeder
Copy link
Owner

lutzroeder commented Dec 31, 2023 •
edited

Tasks:

  • Quantization
  • Architecture generation

Source:
gguf_init_from_file

Examples:
mixtral-8x7b-v0.1.Q4_K_M.gguf.zip
phi-2.Q2_K.gguf.zip
vicuna-33b.Q2_K.gguf.zip
@lutzroeder lutzroeder changed the title GGML support GGUF support Dec 31, 2023
lutzroeder added a commit that referenced this issue Dec 31, 2023
@lutzroeder
Add GGUF support (#1209)
626a9c7
lutzroeder added a commit that referenced this issue Dec 31, 2023
@lutzroeder
Add GGUF support (#1209)
0c78c64
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Add GGUF support (#1209)
c676e09
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Add GGUF support (#1209)
c4ee314
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Add GGUF support (#1209)
46de617
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Update ggml.js (#1209)
998c4dd
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Add .gguf extension (#1209)
adb9f19
lutzroeder added a commit that referenced this issue Jan 3, 2024
@lutzroeder
Update ggml.js (#1209)
bb123d3
lutzroeder added a commit that referenced this issue Jan 4, 2024
@lutzroeder
Rename ggml.js to gguf.js (#1209)
ab63f81
lutzroeder added a commit that referenced this issue Jan 4, 2024
@lutzroeder
Add GGUF test files (#1209)
09e5327
lutzroeder added a commit that referenced this issue Jan 12, 2024
@lutzroeder
Update gguf.js (#1209)
a89846a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@lutzroeder