Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Outlines version clash with vLLM #414

Open
saattrupdan opened this issue Apr 23, 2024 · 1 comment
Open

[BUG] Outlines version clash with vLLM #414

saattrupdan opened this issue Apr 23, 2024 · 1 comment
Assignees
@saattrupdan
Labels
bug Something isn't working

Comments

@saattrupdan
Copy link
Member

saattrupdan commented Apr 23, 2024 •
edited

馃悰 Describe the bug

Currently, vLLM has set an upper bound of their Outlines dependency, which means that we have to regress to existing previous bugs with earlier Outlines versions.

However, this will be fixed in this vLLM PR, so whenever that has been merged and released, we should update vLLM and Outlines accordingly.

Operating System

Linux

Device

CUDA GPU

Python version

3.11.x

ScandEval version

12.7.0
@saattrupdan saattrupdan added the bug Something isn't working label Apr 23, 2024
@saattrupdan saattrupdan self-assigned this Apr 23, 2024
@saattrupdan saattrupdan mentioned this issue Apr 23, 2024
Merged
@saattrupdan
Copy link
Member Author

It is now this vLLM PR, which contains the fix - waiting for that one to be merged and published.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@saattrupdan saattrupdan

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@saattrupdan