New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于模型输入之前的一些处理 #60

Open

Fujiaoji opened this issue Jan 13, 2022 · 1 comment

Fujiaoji commented Jan 13, 2022

您好，在构造数据输入时，为什么在关系上也要加CLS SEP呢，这样本来A B两种关系，岂不是变成了4种类型关系；

另外在model部分的mask保留了CLS的位置，是把它当做了ROOT，还是说单纯为了后续不用从0开始；

谢谢

northfun commented Feb 4, 2022

因为BERT就是这么做的
CLS代表分类任务，SEP是区分AB句子的。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment