New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

convert qwen 110b gptq checkpoint的时候，qkv_bias 的shape不能被3整除 #1589

Open

CallmeZhangChenchen opened this issue May 13, 2024 · 2 comments

Assignees

CallmeZhangChenchen commented May 13, 2024

Collaborator

jershi425 commented May 15, 2024

@CallmeZhangChenchen Thank you for the feedback. We have not supported Qwen-110B yet. We will support and validate it soon.

jershi425 self-assigned this

Tlntin commented May 21, 2024

i got same error in qwen1.5-32b, i think may caused by GQA(group query attention).
I fix up it in this, pr link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment