Skip to content

Issues: intel/llm-on-ray

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

26 Open 40 Closed
26 Open 40 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Docker files for both CI and User
#216 opened May 11, 2024 by xwu99
@yutianchen666
Issue about using ipex on cpu
#197 opened Apr 19, 2024 by KepingYan
Add serve command line options to list all supported model-ids (configured in *yaml)
#177 opened Apr 8, 2024 by xwu99
Openai API not allow temperature=0.0 for llama-2-7b-chat-hf
#139 opened Mar 12, 2024 by yutianchen666
1
propose to add a new folder called ref_apps
#137 opened Mar 11, 2024 by xuechendi
3
Add ipex extra in pyproject.toml to use restricted transformers version
#127 opened Feb 29, 2024 by jiafuzha
1
Enable mllm in CI
#126 opened Feb 28, 2024 by carsonwang
1
Support functions/tools in OpenAI API enhancement New feature or request
#121 opened Feb 23, 2024 by carsonwang
4
Support and validate model Mixtral-8x7B enhancement New feature or request
#119 opened Feb 23, 2024 by carsonwang
1
[Quantization] Support loading AWQ, GPTQ, GGUF/GGML quantized models
#85 opened Jan 26, 2024 by xwu99
[Benchmark] Load config from yaml and output results with multiple formats
#82 opened Jan 24, 2024 by xwu99
[Serving] Example to chat from command line
#74 opened Jan 22, 2024 by carsonwang
[Serving][Benchmark] Add benchmark code for serving
#68 opened Jan 19, 2024 by xwu99
1
Getting dependencies issues while installing on CPU
#67 opened Jan 18, 2024 by nkanike07
13
Getting error while executing query_openai_sdk.py to test the inference
#66 opened Jan 18, 2024 by dkiran1
@kira-lin
9
Not able to run inference server for mistral 7b model, mpt-7b model on Ray
#65 opened Jan 18, 2024 by dkiran1
Gettign error while running start_ui.py
#64 opened Jan 18, 2024 by dkiran1
1
Add type hints to core interfaces
#55 opened Jan 12, 2024 by xwu99
Model evaluation for finetuning and quantization.
#54 opened Jan 11, 2024 by xwu99
[Doc] Document serve simple protocol of request/response
#53 opened Jan 11, 2024 by xwu99
[Serving] Add a table of models and corresponding supported parameters
#51 opened Jan 11, 2024 by KepingYan
[Core] Unifying output printing by using logging with log level
#48 opened Jan 10, 2024 by xwu99
[Lint] Add file license header check
#47 opened Jan 10, 2024 by xwu99
@Deegue
[DOC] Add Coding Style Guide and how to format code to CONTRIBUTING.md
#46 opened Jan 10, 2024 by xwu99
@KepingYan
[REST API] Support more parameters
#22 opened Jan 3, 2024 by KepingYan
2
ProTip! Adding no:label will show everything without a label.