Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pCLUE数据集只有5类标签，与PromptCLUE中的16类任务对应不上 #15

Open
plmsmile opened this issue Apr 13, 2023 · 5 comments
Open

pCLUE数据集只有5类标签，与PromptCLUE中的16类任务对应不上 #15

plmsmile opened this issue Apr 13, 2023 · 5 comments

Comments

@plmsmile
Copy link

plmsmile commented Apr 13, 2023 •
edited

pCLUE 测试数据集 仅5类。以下是pCLUE_test_public.json
classify 57354
mrc 40624
nli 25515
generate 5091
anaphora_resolution 972

PromptCLUE 有16个任务。数据集和任务无法一一对应。
image
@joytianya
Copy link
Collaborator

pCLUE只是开源数据集，用于pCLUE榜单
promptCLUE是开源模型，不止这个数据集

@plmsmile
Copy link
Author

soga谢谢大佬。那PromptCLUE榜单里的完整评测数据集，会开源不，或者除了pCLUE里的还有哪些呀？

@joytianya
Copy link
Collaborator

完整评测数据集就是pCLUE 测试数据集
你说的是promptCLUE训练集？这个后续会陆续开源

@leiqing110
Copy link

pCLUE只是开源数据集，用于pCLUE榜单 promptCLUE是开源模型，不止这个数据集

作者您好，我想在 promptCLUE是开源模型的基础上继续训练自己的文本改写数据，请问您在prompt过程中，改写数据集的格式是什么样的呢

@joytianya
Copy link
Collaborator

可以参考推理的示例哈，见readme

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@joytianya @plmsmile @leiqing110