Skip to content

Issues: marella/ctransformers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

102 Open 96 Closed
102 Open 96 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Support for Llama3
#210 opened Apr 20, 2024 by gultar
2
OSError: .......cannot open shared object file: No such file or directory
#209 opened Apr 17, 2024 by Saurabh11811
2
Error when trying to run on kali linux
#208 opened Apr 16, 2024 by Kuro0911
GGUF MODEL INFERENCE
#206 opened Mar 2, 2024 by 1234AP1234
Inputting embeddings directly
#205 opened Feb 24, 2024 by liechtym
Does ctransformers support ollama models?
#204 opened Feb 21, 2024 by PriyaranjanMarathe
1
Add support for Google's Gemma models
#203 opened Feb 21, 2024 by gultar
Does ctransformers boost the inference speed in llm inference?
#202 opened Feb 15, 2024 by pradeepdev-1995
How to load the finetuned model in safetensors format(not in gguf)
#201 opened Feb 15, 2024 by pradeepdev-1995
Cannot generate text on GPU
#199 opened Jan 2, 2024 by congson1293
3
Add support for Microsoft Phi-2
#197 opened Dec 14, 2023 by niutech
Unsupported Model : Zephyr 'stablelm' GGUF
#196 opened Dec 14, 2023 by Jonathanjordan21
Pulling models outside of hf?
#195 opened Dec 13, 2023 by shell-skrimp
Multimodal models compatibility
#194 opened Dec 13, 2023 by ParisNeo
precompiled rocm and metal wheels
#193 opened Dec 10, 2023 by ParisNeo
GPTQ models are not respecting context_length or max_seq_len settings
#191 opened Dec 6, 2023 by chrsbats
OSError: [WinError 1114] A dynamic link library (DLL) initialization routine failed
#190 opened Dec 6, 2023 by saurabhbluebenz
Unclear error: GGML_ASSERT: D:\a\ctransformers\ctransformers\models\ggml/llama.cpp:453: data
#189 opened Dec 2, 2023 by deveolper
3
request feature: RAG of local docs
#188 opened Nov 30, 2023 by nimzodisaster
Fine-tuning option?
#187 opened Nov 29, 2023 by yukiarimo
OSError: /lib/x86_64-linux-gnu/libm.so.6: version `GLIBC_2.29' not found
#186 opened Nov 28, 2023 by luohao123
1
Build error with GCC12: /usr/lib/gcc/aarch64-linux-gnu/12/include/arm_neon.h:29182:1: error: inlining failed in call to ‘always_inline’ ‘vfmaq_f16’: target specific option mismatch
#185 opened Nov 28, 2023 by denverdino
NotImplementedError when using CTransformers AutoTokenizer
#184 opened Nov 27, 2023 by NasonZ
2
Request: stopping_criteria
#182 opened Nov 23, 2023 by freckletonj
Mistral Sliding Window Attention (SWA)
#181 opened Nov 23, 2023 by stygmate
1
ProTip! Find all open issues with in progress development work with linked:pr.