Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hyperparameter optimization for NN ensemble #569

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

osma
Copy link
Member

@osma osma commented Feb 11, 2022

This PR implements hyperparameter optimization for the NN ensemble, so you can use the annif hyperopt command to look for an optimal neural network configuration against a validate set. The NN ensemble must have already been trained beforehand so that the cached training data is available.

Fixes #435

Opening a draft PR for early feedback from QA tools.

@osma osma self-assigned this Feb 11, 2022
@codecov
Copy link

codecov bot commented Feb 11, 2022

Codecov Report

Merging #569 (6d67fc3) into master (aff0411) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master     #569   +/-   ##
=======================================
  Coverage   99.47%   99.48%           
=======================================
  Files          84       84           
  Lines        5568     5616   +48     
=======================================
+ Hits         5539     5587   +48     
  Misses         29       29           
Impacted Files Coverage Δ
annif/backend/nn_ensemble.py 99.46% <100.00%> (+0.16%) ⬆️
tests/test_backend_nn_ensemble.py 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update aff0411...6d67fc3. Read the comment docs.

@osma osma force-pushed the issue435-hyperopt-nn-ensemble branch from 53367c1 to 7447ede Compare February 11, 2022 13:50
@sonarcloud
Copy link

sonarcloud bot commented Feb 11, 2022

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@sonarcloud
Copy link

sonarcloud bot commented Mar 16, 2022

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Hyperparameter optimization for nn_ensemble backend
1 participant