Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

baichuan-inc_Baichuan2-7B-Chat can't training #678

Open
xiaohangguo opened this issue Nov 13, 2023 · 2 comments
Open

baichuan-inc_Baichuan2-7B-Chat can't training #678

xiaohangguo opened this issue Nov 13, 2023 · 2 comments
Labels
pending Something isn't working

Comments

@xiaohangguo
Copy link

xiaohangguo commented Nov 13, 2023 •
edited

感觉是baicihuan2的tokenizer做了更新，可能需要适配一下
报了个这样的错误：
Tokenizer class BaichuanTokenizer does not exist or is not currently imported.

版本的话是用的最新的代码，v0.05。
感觉改一下tokenizer应该就可以。
@xiaohangguo xiaohangguo added the pending Something isn't working label Nov 13, 2023
@research4pan
Copy link
Contributor

Thanks for your interest in LMFlow! We will import this feature in the near future. We also encourage any contributions on this matter. If you are interested in contributing to LMFlow, please feel free to add a new pull request 🤗

@xiaohangguo
Copy link
Author

哈哈，好的，如果我能在你们更新之前pr的话

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
pending Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@research4pan @xiaohangguo