Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement request] Target the #1 SOTA for v5.0 #334

Open
LifeIsStrange opened this issue Feb 7, 2022 · 0 comments
Open

[Enhancement request] Target the #1 SOTA for v5.0 #334

LifeIsStrange opened this issue Feb 7, 2022 · 0 comments

Comments

@LifeIsStrange
Copy link

LifeIsStrange commented Feb 7, 2022

According to the huggingface blog, neuralcoref is an adaptation of Improving Coreference Resolution by Learning Entity-Level Distributed Representations, which has an accuracy of 65.29 on Ontonotes.
There is a market for making SOTA papers more available and easily useable. It's a real need. Spacy here is an excellent choice. However.. 65.29 is mediocre.
The state of the art in 2021 is 81% of accuracy AKA a 16 % increase.. This makes the difference between a cool demo and something that can begin to become used in the industry.
As a reminder, the SOTA of every NLP/NLU task is easily available and generally up to date on https://paperswithcode.com/sota/coreference-resolution-on-ontonotes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant