New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add a classification accuracy objective #294
Comments
related to this, we should also implement balanced accuracy |
Got it, will update the objectives project plan w/ this! |
@angela97lin my suggestion is to list this issue in the future work section if you want, but to not allow it to affect the current objective API project scope. I think our priority should still be to finish the project; then this would be a great first issue to work on once we have it done. That sound ok? |
Ok after talking to Max and Angela, the plan is:
|
Definition (from wikipedia):
This came up in the discussion around Dan Putler's initial work on a cross-platform performance comparison yesterday (notes in #293). Dan used a classification accuracy objective in Applied Modeling, H20 and R, but used recall in evalml. If we implement accuracy, that may provide a better performance comparison. Plus, the more metrics we support, the better.
It would be great to keep our implementation general enough to handle multiclass, but if we have to start with binary classification, so be it.
The text was updated successfully, but these errors were encountered: