evalutils helps challenge administrators easily create evaluation containers for grand-challenge.org.
- Free software: MIT license
- Documentation: https://comic.github.io/evalutils/.
- Generation your challenge evaluation project boilerplate using Cookiecutter
- Scripts to build, test and export your generated docker container for grand-challenge.org
- Loading of CSV, ITK and Pillow compatible prediction files
- Validation of submitted predictions
- Interface to SciKit-Learn metrics and Pandas aggregations
- Bounding box annotations with Jaccard Index calculations
evalutils requires Python 3.8 or
above, and can be installed from pip.
Please see the Getting Started
documentation for more details.