-
Notifications
You must be signed in to change notification settings - Fork 15
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
method for calculating p-value #3
Comments
Hi @chenypic. This repo implements bootstrapping. Based on a quick research, I don't think it's equivalent to the DeLong test. |
@mateuszbuda Is there any reference or statistical justification behind your implementation? Usually bootstrapping is used on the training set to account for model uncertainty, which is computationally expensive when training large models. Bootstrapping the predicted probabilities is much faster but I haven't found any statistical proof on this method. |
@Amin-Tajgardoon Here are selected results for the phrase "bootstrapping hypothesis testing" from Google:
|
@mateuszbuda Thank you for the reply. I'll take a look at the references. |
Thank you so much for your ml-stat-util.
I want to know the method you compute the p-value. Is it the same as the DeLong test?
The text was updated successfully, but these errors were encountered: