Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Link charts in the overview page to the data browser #173

Open
DerEchteFeuerpfeil opened this issue Nov 11, 2022 · 0 comments
Open

Link charts in the overview page to the data browser #173

DerEchteFeuerpfeil opened this issue Nov 11, 2022 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@DerEchteFeuerpfeil
Copy link

Is your feature request related to a problem? Please describe.
The most useful thing for the charts on the overview page is that I can not only monitor my data, but also directly improve it. If I see WS and manual labels not being aligned in the confusion matrix, I instinctively want to check out the conflicts in the data browser. Currently I have to memorise what values for WS and manual I want to look at for what labeling task and then go into the data browser and manually put these values into the filter options. That is unfortunately a lot of manual effort and opens up the room for error.

Describe the solution you'd like
I really would like these charts to be linked to the data browser. So if I see a conflict in the confusion matrix, I want to be able to click on it and be redirected to the data browser with the right filters in place automatically.

The cool thing is, that in theory this can be done with every chart.

Label distribution: clicking on the "manually labeled" bar for label "business" redirects you to the data browser with the filter "(ML-label IN (business))"

Confidence distribution: Select a range of either percentiles (horizontal selection) or WS confidences (vertical selection) and redirect to the data browser with the WS confidence filter set to the respective values.

Confusion matrix: Click on one tile, e.g. "WS business / Manual sports", and be redirected to the data browser with the filters set to exactly that.

Inter annotator agreement: This one is a bit tricky as it could both mean that one wants to see the disagreement or one wants to see the records that were labeled by both. So that would need a little more discussion I think.

Describe alternatives you've considered
Doing everything manually.

Additional context

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants