New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix error and support Phi-3 models #3318

Open

renning22 wants to merge 1 commit into lm-sys:main from renning22:fix_phi3

Contributor

renning22 commented May 7, 2024 •

edited

Why are these changes needed?

Model worker (also vllm_worker) has error loading Phi-3 models "microsoft/Phi-3-mini-128k-instruct" etc..

Checks

I've run format.sh to lint the changes in this PR.
I've included any doc changes needed.
I've made sure the relevant tests are passing (if applicable).


          fix error loading "microsoft/Phi-3-mini-128k-instruct"

c20bf80

Contributor Author

renning22 commented May 8, 2024

@merrymercy @Ying1123 PTAL, thanks~

icowan added a commit to icowan/FastChat that referenced this pull request


          fix error and support Phi-3 models lm-sys#3318

fd9ac3d

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment