Skip to content

Issues: mlc-ai/mlc-llm

Project Tracking
#647 opened Aug 2, 2023 by tqchen
Open
Model Request Tracking
#1042 opened Oct 9, 2023 by CharlieFRuan
Open 4
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

133 Open 995 Closed
133 Open 995 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Question] Quantization Problems question Question about the usage
#2523 opened Jun 6, 2024 by ponytaill
QWen1.8b acuracy in noquantize bug Confirmed bugs
#2522 opened Jun 6, 2024 by chenzhenbupt
1
[Bug] chatglm4 mlc_llm gen_config shows error 'ChatGLM4Tokenizer' object has no attribute 'backend_tokenizer' and then Segmentation fault bug Confirmed bugs
#2517 opened Jun 6, 2024 by lihaofd
2
[Question] Running mlc_llm into a multi-phase container build question Question about the usage
#2512 opened Jun 5, 2024 by oglok
7
mlc_llm package is ERROR: returned non-zero exit status[Bug] bug Confirmed bugs
#2511 opened Jun 5, 2024 by panghongtao
2
[Bug] FlashInfer decode BeginForward error an illegal instruction was encountered bug Confirmed bugs
#2509 opened Jun 4, 2024 by zifeitong
@yzh119
1
[Feature Request] please allow f32q5_k and f16q5_k quantizations feature request New feature or request
#2506 opened Jun 4, 2024 by 0wwafa
[Bug] SEVERE downstream task performance degradation compared to uncompiled model bug Confirmed bugs
#2499 opened Jun 4, 2024 by 0xLienid
9
[Bug] mlc_llm serve throws CUDA: invalid device ordinal bug Confirmed bugs
#2498 opened Jun 3, 2024 by josephrocca
4
[Question] Cannot compile custom model to work on web browser question Question about the usage
#2485 opened Jun 2, 2024 by lawofcycles
[Model Request] T5 new-models
#2483 opened May 31, 2024 by starlight70
[Bug] iOS | mlc_llm package not working bug Confirmed bugs
#2477 opened May 30, 2024 by iOSDevCodiste
6
[Doc] benchmark on different hardware documentation Improvements or additions to documentation
#2475 opened May 30, 2024 by louis030195
[Doc] Request for suggested build-from-source options + explanation of added functionality documentation Improvements or additions to documentation
#2473 opened May 30, 2024 by BuildBackBuehler
Compiling WebAssembly library with debug symbols/source map to aid in debugging question Question about the usage
#2472 opened May 30, 2024 by slash-under
mlc_llm serve fails on concurrent users - Llama3 70B parameter hosting bug Confirmed bugs
#2462 opened May 29, 2024 by swamysrivathsan
3
'ChatGLMTokenizer' object has no attribute 'backend_tokenizer' bug Confirmed bugs
#2460 opened May 29, 2024 by lihaofd
1
qwen1.5-0.5B-chat : lm_head.weight question Question about the usage
#2458 opened May 29, 2024 by viaowp
6
[Doc] Python API KV/memory reset details absent documentation Improvements or additions to documentation
#2426 opened May 26, 2024 by federicoparra
6
[Feature Request] phi-3 small realeased -> performs two times ebtter then Phi-3 mini feature request New feature or request
#2420 opened May 26, 2024 by sebastienbo
1
Phi-2 q4f16_1 runs faster when compiled without tvm.relax.transform.FuseOps() and tvm.relax.transform.FuseTIR() transformations bug Confirmed bugs
#2405 opened May 24, 2024 by MMuzzammil1
4
[Bug] phi 2 q4 model doesn't work bug Confirmed bugs
#2398 opened May 24, 2024 by speed40
Fail to build tvm-unity from source on orin[Bug] bug Confirmed bugs
#2389 opened May 23, 2024 by Louym
2
[Model Request] Phi-3-Vision new-models
#2388 opened May 23, 2024 by NSTiwari
4
[Bug] java.lang.NullPointerException: Attempt to invoke virtual method 'org.apache.tvm.TVMValue org.apache.tvm.Function.invoke()' on a null object reference bug Confirmed bugs
#2366 opened May 21, 2024 by View999888
2
ProTip! Follow long discussions with comments:>50.