New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cmrc排行榜如何查看F1分值 #150

Open

conan1024hao opened this issue Jun 14, 2022 · 3 comments

conan1024hao commented Jun 14, 2022

您好，我注意到cmrc2018的排行榜只会显示EM的分数，请问有办法查看F1的分数吗？

Author

conan1024hao commented Jun 25, 2022

1 similar comment

805934132 commented Sep 21, 2022

Member

brightmart commented Sep 24, 2022

Hi，阅读理解上述指标中F1和EM共存的情况下，取EM为最终指标。
如果是验证集/开发集，可以参考一下这个脚本：https://github.com/CLUEbenchmark/CLUE/blob/master/baselines/models_pytorch/mrc_pytorch/run_mrc.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment