Skip to content

Issues: rustformers/llm

Does it support the new GGMLv3 quantization methods?
#286 opened May 29, 2023 by Exotik850
Open 5
Support GGUF
#365 opened Jul 10, 2023 by philpax
Open 4
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

81 Open 150 Closed
81 Open 150 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Question: GPU support
#456 opened Apr 28, 2024 by toastxc
Not enough space in the context's memory pool
#455 opened Apr 17, 2024 by thecodechemist99
Out of context answers
#453 opened Mar 15, 2024 by DravidVaishnav
Include bytes of model in program?
#452 opened Mar 6, 2024 by Lamby777
1
Sub reddit is down
#451 opened Feb 10, 2024 by Gamithon
2
Currently in dev any inference is broken
#450 opened Feb 8, 2024 by gadLinux
2
When using tokio and HuggingFaceRemote it breaks dropping the runtime
#449 opened Feb 8, 2024 by gadLinux
1
Build fails: error: no such file or directory: 'ggml/src/ggml.c'
#448 opened Dec 26, 2023 by yurivict
Behavior when missing quantization version
#447 opened Dec 20, 2023 by Reichenbachian
1
EOS is not read from gguf format
#446 opened Dec 19, 2023 by Alisa-lisa
@philpax
1
Support Separate Loading of Vocabulary or Tensors
#445 opened Dec 13, 2023 by skirodev
Why is the feed_prompt process so slow?
#439 opened Nov 4, 2023 by zackshen
1
5
Reduce dependencies issue:enhancement New feature or request meta:maintenance Changes that will make it easier for us to maintain code
#437 opened Oct 31, 2023 by philpax
Disable tokenizers-remote support for the library by default issue:enhancement New feature or request meta:breaking-change Will require action on behalf of the developer
#436 opened Oct 31, 2023 by philpax
1
Support for Mistral-7b issue:enhancement New feature or request topic:model-support Support for new models
#434 opened Sep 27, 2023 by ranaya-formant
5
How to disable ggml logging?
#433 opened Sep 23, 2023 by mrwilby
1
Clarify MSRV policy
#431 opened Sep 18, 2023 by chris-ha458
2
How do I use Huggingface tokenization to use a model on Huggingace in MODEL_PATH instead of my local machine?
#427 opened Sep 14, 2023 by alfellati
1
Medusa Speculative Decoding
#423 opened Sep 11, 2023 by someone13574
1
SIGTRAP triggered on MacOS
#422 opened Sep 6, 2023 by jafioti
2
Default String for ConfiguredSamplers
#420 opened Sep 4, 2023 by JuliaMerz
1
NaN logits on LLaMA 65B when using 2k+ token contexts
#418 opened Aug 30, 2023 by hugoabonizio
WizardCoder llama assert failure
#417 opened Aug 28, 2023 by jacohend
3
AMD ROCm support with HIPBLAS
#415 opened Aug 27, 2023 by xangelix
2
Api Server Example
#414 opened Aug 25, 2023 by e253
5
ProTip! Updated in the last three days: updated:>2024-05-12.