Skip to content

Issues: ray-project/ray-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

58 Open 31 Closed
58 Open 31 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Running ray-llm 0.5.0 on g4dn.12xlarge instance
#150 opened Apr 26, 2024 by golemsentience
2
Is this project still actively being maintained?
#148 opened Apr 17, 2024 by nkwangleiGIT
8
templating serve-config and model config instead of copy and paste
#147 opened Apr 16, 2024 by nhaocalgary
Error when serve run
#144 opened Mar 25, 2024 by andakai
1
RAY-LLM stuck at replica step
#143 opened Mar 24, 2024 by NBTrong
1
Run rayllm frontend on head pod fails
#142 opened Mar 11, 2024 by viirya
1
serve status fails on the head pod after model is deployed
#141 opened Mar 11, 2024 by viirya
RayWorkerVllm Actor Dies After ~1h: The actor is dead because all references to the actor were removed.
#140 opened Mar 7, 2024 by cshyjak
Issue when running ray-llm with tensorrt-llm
#139 opened Mar 6, 2024 by leon-g-xu
1
There should be a feature saying that all of the 3 options are wrong
#137 opened Mar 4, 2024 by ollie-iterators
1
Autoscaling support in Ray-llm
#133 opened Feb 21, 2024 by Jeffwan
Support for the Mistral based Embeddings models
#132 opened Feb 9, 2024 by lynkz-matt-psaltis
In the 0.5.0 release, some files appear to be missing
#131 opened Feb 8, 2024 by lynkz-matt-psaltis
Serve a new model without restarting RayLLM
#130 opened Feb 2, 2024 by k6l3
1
A100 not correctly detected / No available node types can fulfill resource request
#129 opened Jan 31, 2024 by wizche
Podman Error on red hat 9?
#127 opened Jan 25, 2024 by jayteaftw
[BUG] workers do not launch on g5.12xlarges for the latest image 0.5.0.
#125 opened Jan 22, 2024 by JGSweets
6
Queue-Worker System
#123 opened Jan 22, 2024 by AIApprentice101
2
Add a example of Azure GPU
#118 opened Jan 17, 2024 by chenweisomebody126
1
How to use partial GPU?
#117 opened Jan 10, 2024 by rifkybujana
2
Ray-LLM Head with VLLM Head throws configuration error
#114 opened Jan 8, 2024 by lynkz-matt-psaltis
2
Permission denied when downloading or serving any model.
#112 opened Jan 6, 2024 by Anindyadeep
Cannot specify models using yaml as a list of dicts or LLMApp objects
#109 opened Dec 27, 2023 by victorserbu2709
Error: Tokenizer class does not exist when load local model
#108 opened Dec 22, 2023 by YixuanCao
@sihanwang41
1
How to submit a LLM training job?
#106 opened Dec 15, 2023 by qingqiuhe
@richardliaw
2
ProTip! Adding no:label will show everything without a label.