Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Ablation importance to DeepCave #110

Open
sarah-segel opened this issue Jan 16, 2024 · 0 comments
Open

Add Ablation importance to DeepCave #110

sarah-segel opened this issue Jan 16, 2024 · 0 comments
Assignees
@KrissiHub
Labels
feature request
Milestone
v2.0

Comments

@sarah-segel
Copy link
Contributor

sarah-segel commented Jan 16, 2024 •
edited

See https://automl.github.io/ParameterImportance/algorithms.html#ablation

Example Notebook that can be transferred to DeepCAVE:
Ablation_example.zip

Changes required:

  • Should consider only positive HP changes
  • Multiple iterations & averaging should be possible (could then show the average increase in performance when using the HP incumbent as the importance?)
@sarah-segel sarah-segel added this to the v2.0 milestone Jan 16, 2024
@helegraf helegraf removed this from the v2.0 milestone Jan 18, 2024
@sarah-segel sarah-segel added this to the v2.0 milestone Feb 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@KrissiHub KrissiHub

Labels
feature request
Projects
None yet
Milestone
v2.0
Development

When branches are created from issues, their pull requests are automatically linked.

110-add-ablation-importance-to-deepcave automl/DeepCAVE
3 participants
@helegraf @sarah-segel @KrissiHub