Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问能开放基于clue数据的base模型,large太大训不动,tiny又不如bert base。 #11

Open
InsaneLife opened this issue Mar 26, 2020 · 2 comments

Comments

@InsaneLife
Copy link

InsaneLife commented Mar 26, 2020

如题。
因为看模型对比里面有BERT-base基于clue_vocab训练的,做了速度对比。

ps: RoBERTa-large-clue词表和配置不一样。vocab大小是8021,config文件大小是21128。

@DukeEnglish
Copy link
Contributor

DukeEnglish commented Mar 27, 2020 via email

@InsaneLife
Copy link
Author

因为看模型对比里面有BERT-base基于clue_vocab训练的,做了速度对比,能否开放更多模型,最好是base,太大训练不动啊

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants