Skip to content
This repository has been archived by the owner on Nov 10, 2018. It is now read-only.

Simple Interactive Evaluator #228

Open
JVonderwell opened this issue Apr 23, 2018 · 1 comment
Open

Simple Interactive Evaluator #228

JVonderwell opened this issue Apr 23, 2018 · 1 comment
Assignees

Comments

@JVonderwell
Copy link
Contributor

We'd like a simple way for users to self-evaluate holoclean's performance in cases where we don't have a ground truth. This will amount to essentially just listing each change (or a subset of changes) to the user and asking them "did HC do the right thing?" and calculating simple precision metrics based off of that.

Benefit: Providing users and ourselves a basic understanding of HC's performance on a given dataset.

Cost: Maybe a couple hours of coding to structure and test.

@JVonderwell
Copy link
Contributor Author

TODO: Week of 4/23

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants