Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HSTree LOOCV Speed-up #175

Open
csinva opened this issue Jun 1, 2023 · 0 comments
Open

HSTree LOOCV Speed-up #175

csinva opened this issue Jun 1, 2023 · 0 comments

Comments

@csinva
Copy link
Owner

csinva commented Jun 1, 2023

We want to improve HSTree by selecting the regularization parameter using the GCV ridge formula.

This requires extracting tree features and then just using sklearn's ridge class to compute GCV for different regularization parameters. @aagarwal1996 can you implement this by using the gMDI code to do the extraction?

For ensembles, we also want parallelize over trees (see #125) and maybe use out-of-bag samples for trees to perform cross-validation.

In #174, @OmerRonen sped up the HSTree fitting by changing the code to vary only the regularization parameter rather than refit many trees.

cc @Innixma

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant