Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Computing Metrics for a Regression problem #174

Open
anujk3 opened this issue Nov 3, 2021 · 1 comment
Open

Computing Metrics for a Regression problem #174

anujk3 opened this issue Nov 3, 2021 · 1 comment
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@anujk3
Copy link

anujk3 commented Nov 3, 2021

💡 Feature request

For all the sample notebooks given, we are computing the metrics where the outcome y is taken as a binary output, can we also do this for a regression problem and how it will change all the metrics and the corresponding curves?

Motivation

An example in the library for the regression problems will also help the users use sklift for similar problems

Additional context

Currently metrics assume y_val as a binary variable, what if its a regression problem? How to modify the metrics to not check for y_value as boolean and compute them?

@maks-sh maks-sh added enhancement New feature or request help wanted Extra attention is needed labels Nov 8, 2021
@maks-sh
Copy link
Owner

maks-sh commented Nov 8, 2021

Hi, @anujk3! Thanks for your feedback.

Indeed, the package supports only classification metrics now.

I think it is possible to start developing metrics for a regression problem with a Qini curve.
More information can be found in section Continuous outcomes of the article Nicholas J Radcliffe. (2007). Using control groups to target on predicted lift: Building and assessing uplift model. Direct Marketing Analytics Journal, (3):14–21, 2007.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants