0.6.0

Commits

• 0bbcfed: New version release (github-actions[bot])
• 2b017f3: Move responsibilities from context to dataset (#767) (matanper) #767
• 9a54486: [issue-650] functionality split (#751) (Yurii Romanyshyn) #751
• 3defd1b: small fix (#770) (Yurii Romanyshyn) #770
• 65739b7: links-checks github action fix (#775) (Yurii Romanyshyn) #775
• 08a350f: added_series_predict_support (#771) (JKL98ISR) #771
• 2543d85: updated makefile (#780) (Yurii Romanyshyn) #780
• 08b9d75: Adding base vision package (#773) (Itay Gabbay) #773
• 0fdb33d: Add links to suite in where to use docs (#783) (matanper) #783
• 39bfef7: Making the notebooks gen multi-procces (#785) (Itay Gabbay) #785
• e6e36c3: Vision docs placeholder (#788) (Itay Gabbay) #788
• 142524d: Fixing rtd build (#790) (Itay Gabbay) #790
• 0b2886f: Add sample data loader & sample predictions and label caching (#786) (matanper) #786
• 7995a74: Fix pandas warning (#792) (JKL98ISR) #792
• e2ba947: [issue-781] moved checks base classes to core (#789) (Yurii Romanyshyn) #789
• e739cc5: Fixing nb generation (#795) (Itay Gabbay) #795
• c2bca9a: [issue-757] updated MNIST dataset api (#798) (Yurii Romanyshyn) #798
• 8eb0187: Adding 2022 to license (#802) (Itay Gabbay) #802
• d4d33a6: Label drift fixes (#797) (Nir Hutnik) #797
• 7c9ae4e: Adding labels and detection encoder classes (#800) (Itay Gabbay) #800
• 3d84a3e: fix_widget_plotly_bug (#807) (JKL98ISR) #807
• 0abec77: New version release (github-actions[bot])
• bcd6de2: Updated Readme (#814) (shir22) #814
• 0edb5b5: rename VisionDataset to VisionData (#820) (Noam Bressler) #820
• 4bcd1d7: [DOCS] Updated main page and when should you use page (shir22) #821
• ec71505: add DataFormatter (#812) (Noam Bressler) #812
• 66b7f28: Fixing label drift in vision submodule (#823) (Itay Gabbay) #823
• b3bf954: rename to ImageFormatter and fix bug in VisionData init (#824) (Noam Bressler) #824
• d546f38: [issue-799] coco split into train/test; updated coco dataset module api (#805) (Yurii Romanyshyn) #805
• f9b1ef6: change checks to init - update - compute structure (#826) (Noam Bressler) #826
• ec307ea: Fixing CI (#838) (Itay Gabbay) #838
• 0833fd8: Label drift fixes (#808) (Nir Hutnik) #808
• 11230f6: Label drift refactor (#843) (Nir Hutnik) #843
• 0a68f7f: Adding performance report nb (#844) (Itay Gabbay) #844
• 8e852a5: Update README.rst (#849) (JKL98ISR) #849
• f911fe8: Added typehints where they were missing in CheckResult's methods. Also slightly improved english in docs for those functions (#848) (RonItay) #848
• 77735cd: Formatter docs (#837) (Itay Gabbay) #837
• b2f0c20: [issue-787] added device parameter to the vision checks context (#832) (Yurii Romanyshyn) #832
• 1f9f6b4: Added properties in image formatter (#855) (Nir Hutnik) #855
• 29302fa: Vision quickstart notebook (#853) (Noam Bressler) #853
• de7bab1: Robustness Report (#801) (matanper) #801
• 2ace56c: Image properties (#858) (Nir Hutnik) #858
• aaa22c7: suite fixes (#857) (Yurii Romanyshyn) #857
• 595b58d: Vision docs (#860) (Itay Gabbay) #860
• ba13a32: add export to html to quickstart (#865) (Noam Bressler) #865
• 754b25a: Adding class display limit in ClassPerformance check (#866) (Itay Gabbay) #866
• c7ccd5b: Add title to drift plot (#867) (Noam Bressler) #867
• eb5ecd8: Improved metric (#825) (JKL98ISR) #825
• 69a0f65: Added imgaug-equivalent augmentations. (#869) (Nir Ben-Zvi) #869
• 1e62372: add wrap_run to ModelComparisonCheck (#868) (Noam Bressler) #868
• fee9fd5: remove warnings from main (#870) (JKL98ISR) #870
• 44e2551: Modifying make notebook (#873) (Itay Gabbay) #873
• 0ffe328: Add recall to default metrics (#872) (JKL98ISR) #872
• fbd8e46: Fixing deployment (#861) (Itay Gabbay) #861
• 8dcb676: Vision domain classifier issue 841 (#879) (Nir Hutnik) #879
• 988eed7: MeanAveragePrecisionReport check (#880) (JKL98ISR) #880
• d25643e: Formatters validation (#875) (matanper) #875
• dccb198: v1 (#885) (JKL98ISR) #885
• 28e5eb5: Fix version read in init (#891) (matanper) #891
• 45e379a: fix_cells (JKL98ISR)
• 3f98ce3: Revert "fix_cells" (JKL98ISR)
• 148e0df: Adding label_map to dataset (#877) (Itay Gabbay) #877
• d31a0cb: Vision Suite refactor (#890) (JKL98ISR) #890
• 547b225: Fixed (maybe?) the tests (#893) (Nir Hutnik) #893
• ec6122b: Make image drift tests consistent (#902) (matanper) #902
• a9595a4: fixing docs (#898) (Itay Gabbay) #898
• 1220e7f: Vision model comparison (#897) (Itay Gabbay) #897
• 61b30a0: Save mnist model for tests - Fix robustness test (#905) (matanper) #905
• b68f44e: Set seed in vision context (#904) (matanper) #904
• 5c3f663: [Issue 834] label formatters (#882) (Yurii Romanyshyn) #882
• 12f5e34: Changing alternative_metrics to Dict (#907) (Itay Gabbay) #907
• 9ec023e: set default prediction formatters per task type (#909) (Noam Bressler) #909
• e196de6: The notebook is back (#900) (Nir Hutnik) #900
• 580a12c: Robustness + VisionData: copy generator when copying dataset (#924) (matanper) #924
• b801321: Update robustness report notebook (#913) (matanper) #913
• f0e45e8: Remove state copying and setting seed in robustness_report (#926) (matanper) #926
• fc854e0: Gpu fixes (#912) (Itay Gabbay) #912
• 2cecf54: Heatmap comp (#901) (Noam Bressler) #901
• b7fa71c: add confusion matrix (#828) (DBI) #828
• d347792: [Issue 755] Property Drift Check (#908) (Yurii Romanyshyn) #908
• c89c4c3: version bump (#927) (Itay Gabbay) #927
• e3336a0: Add new checks to vision full suite (Noam Bressler) #929
• 3ab5dbd: Wandb integration (#906) (JKL98ISR) #906
• e7f6149: Fix bugs when task_type is None and remove print (#937) (Noam Bressler) #937
• 0e0fba2: Adding gpu tests (#939) (Itay Gabbay) #939
• f767889: Adding explanations to label drift...

0.5.0

Main Features

• Introducing Weights and Biases integration

Full Changelog: 0.4.2...0.5.0

0.5.0.dev2

What's Changed

• Move responsibilities from context to dataset by @matanper in #767
• [issue-650] functionality split by @yromanyshyn in #751
• functionality-split additional fix by @yromanyshyn in #770
• links-checks github action fix by @yromanyshyn in #775
• added tests for single feature data + improved tests by @JKL98ISR in #771
• updated makefile by @yromanyshyn in #780
• Adding base vision package by @ItayGabbay in #773
• Add links to suite by @matanper in #783
• Making the notebooks gen multi-procces by @ItayGabbay in #785
• Vision docs placeholder by @ItayGabbay in #788
• Fixing rtd build by @ItayGabbay in #790
• Add sample data loader & sample predictions and label caching by @matanper in #786
• Fix pandas warning by @JKL98ISR in #792
• [issue-781] moved checks base classes to core by @yromanyshyn in #789
• Fixing nb generation by @ItayGabbay in #795
• [issue-757] updated MNIST dataset api by @yromanyshyn in #798
• Adding 2022 to license by @ItayGabbay in #802
• Label drift fixes by @nirhutnik in #797
• Adding labels and detection encoder classes by @ItayGabbay in #800
• Fix widget plotly bug by @JKL98ISR in #807
• 📓 Updating Readme by @shir22 in #814
• rename VisionDataset to VisionData by @noamzbr in #820
• [DOCS] Updated main page and when should you use page by @shir22 in #821
• add DataFormatter by @noamzbr in #812
• Fixing label drift in vision submodule by @ItayGabbay in #823
• rename to ImageFormatter and fix bug in VisionData init by @noamzbr in #824
• [issue-799] coco split into train/test; updated coco dataset module api by @yromanyshyn in #805
• change checks to init - update - compute structure by @noamzbr in #826
• Fixing CI by @ItayGabbay in #838
• Label drift fixes by @nirhutnik in #808
• Label drift refactor by @nirhutnik in #843
• Adding performance report nb by @ItayGabbay in #844
• fix README.rst typo train-test by @JKL98ISR in #849
• Added typehints where they were missing in CheckResult's methods. by @RonItay in #848
• Formatter docs by @ItayGabbay in #837
• [issue-787] added device parameter to the vision checks context by @yromanyshyn in #832
• Added properties in image formatter by @nirhutnik in #855
• Vision quickstart notebook by @noamzbr in #853
• Robustness Report by @matanper in #801
• Image properties by @nirhutnik in #858
• suite fixes by @yromanyshyn in #857
• Vision docs by @ItayGabbay in #860
• add export to html to quickstart by @noamzbr in #865
• Adding class display limit in ClassPerformance check by @ItayGabbay in #866
• Add title to drift plot by @noamzbr in #867
• Improved metric by @JKL98ISR in #825
• Added imgaug-equivalent augmentations. by @nirbenz in #869
• add wrap_run to ModelComparisonCheck by @noamzbr in #868
• remove warnings by @JKL98ISR in #870
• Modifying make notebook by @ItayGabbay in #873
• Add recall to default metrics by @JKL98ISR in #872
• Fixing deployment by @ItayGabbay in #861
• Vision domain classifier issue 841 by @nirhutnik in #879
• MeanAveragePrecisionReport check by @JKL98ISR in #880
• Formatters validation by @matanper in #875
• Mean Average Recall Report check by @JKL98ISR in #885
• Fix version read in init by @matanper in #891
• Adding label_map to dataset by @ItayGabbay in #877
• Vision Suite refactor by @JKL98ISR in #890
• Fixed (maybe?) the tests by @nirhutnik in #893
• Make image drift tests consistent by @matanper in #902
• fixing docs by @ItayGabbay in #898
• Vision model comparison by @ItayGabbay in #897
• Save mnist model for tests by @matanper in #905
• Set seed in vision context and fix YOLO tests by @matanper in #904
• [Issue 834] label formatters by @yromanyshyn in #882
• Changing alternative_metrics to Dict by @ItayGabbay in #907
• set default prediction formatters by @noamzbr in #909
• The notebook is back by @nirhutnik in #900
• Robustness + VisionData: copy generator when copying dataset by @matanper in #924
• Update robustness report notebook by @matanper in #913
• Remove state copying and setting seed in robustness_report by @matanper in #926
• Gpu fixes by @ItayGabbay in #912
• Heatmap comp by @noamzbr in #901
• add confusion matrix by @benisraeldan in #828
• [Issue 755] Property Drift Check by @yromanyshyn in #908

New Contributors

• @RonItay made their first contribution in #848
• @nirbenz made their first contribution in #869

Full Changelog: 0.4.0...0.5.0.dev2

0.5.0.dev0

What's Changed

• Move responsibilities from context to dataset by @matanper in #767
• [issue-650] functionality split by @yromanyshyn in #751
• functionality-split additional fix by @yromanyshyn in #770
• links-checks github action fix by @yromanyshyn in #775
• added tests for single feature data + improved tests by @JKL98ISR in #771
• updated makefile by @yromanyshyn in #780
• Adding base vision package by @ItayGabbay in #773
• Add links to suite by @matanper in #783
• Making the notebooks gen multi-procces by @ItayGabbay in #785
• Vision docs placeholder by @ItayGabbay in #788
• Fixing rtd build by @ItayGabbay in #790
• Add sample data loader & sample predictions and label caching by @matanper in #786
• Fix pandas warning by @JKL98ISR in #792
• [issue-781] moved checks base classes to core by @yromanyshyn in #789
• Fixing nb generation by @ItayGabbay in #795
• [issue-757] updated MNIST dataset api by @yromanyshyn in #798
• Adding 2022 to license by @ItayGabbay in #802
• Label drift fixes by @nirhutnik in #797
• Adding labels and detection encoder classes by @ItayGabbay in #800
• Fix widget plotly bug by @JKL98ISR in #807
• 📓 Updating Readme by @shir22 in #814
• rename VisionDataset to VisionData by @noamzbr in #820
• [DOCS] Updated main page and when should you use page by @shir22 in #821
• add DataFormatter by @noamzbr in #812
• Fixing label drift in vision submodule by @ItayGabbay in #823
• rename to ImageFormatter and fix bug in VisionData init by @noamzbr in #824
• [issue-799] coco split into train/test; updated coco dataset module api by @yromanyshyn in #805
• change checks to init - update - compute structure by @noamzbr in #826
• Fixing CI by @ItayGabbay in #838
• Label drift fixes by @nirhutnik in #808
• Label drift refactor by @nirhutnik in #843
• Adding performance report nb by @ItayGabbay in #844
• fix README.rst typo train-test by @JKL98ISR in #849
• Added typehints where they were missing in CheckResult's methods. by @RonItay in #848
• Formatter docs by @ItayGabbay in #837
• [issue-787] added device parameter to the vision checks context by @yromanyshyn in #832
• Added properties in image formatter by @nirhutnik in #855
• Vision quickstart notebook by @noamzbr in #853
• Robustness Report by @matanper in #801
• Image properties by @nirhutnik in #858
• suite fixes by @yromanyshyn in #857
• Vision docs by @ItayGabbay in #860

New Contributors

• @RonItay made their first contribution in #848

Full Changelog: 0.4.0...0.5.0.dev0

0.4.2

What's Changed

• Fix widget plotly bug (#807) by @JKL98ISR in #809
• Docs 0.4.x fixes by @shir22 in #817

Full Changelog: 0.4.1...0.4.2

0.4.1

Commits

• b8555e8: Fixing import issues (Itay Gabbay)
• 0764ef1: 0.4.1 (Itay Gabbay)

0.4.0

Deepchecks Version 0.4.0

What's Changed

• Update index.rst by @ItayGabbay in #699
• Adding notebooks by @ItayGabbay in #702
• Build model if loading causes errors by @benisraeldan in #703
• merge kaggle widgets hotfix to main by @JKL98ISR in #709
• update suite exceptions and links by @matanper in #706
• Colab prettier suite view by @JKL98ISR in #717
• Check display read more by @matanper in #715
• [Issue-571] make docs errors/warnings fixes by @yromanyshyn in #725
• make conda build trigger by @JKL98ISR in #726
• Add check context by @matanper in #700
• merge html resources fix from 0.3.2 (#728) by @JKL98ISR in #733
• update readme plot by @JKL98ISR in #720
• Added validations to numpydoc docstrings ✅ by @ItayGabbay in #738
• Update docstrings in default_suites.py by @matanper in #718
• explicitly set default timeout for fi calculation by @noamzbr in #739
• Rename scorers related parameters by @matanper in #734
• Removed generated html files generated from notebook by @matanper in #741
• Warn user when trying to show result in a non-interactive shell by @matanper in #745
• add check display tests by @benisraeldan in #735
• Add more warning for the user when calculating FI by @matanper in #749
• Add FI permutation options to UnusedFeatures by @matanper in #740
• label amibuity notebook improvemnts by @benisraeldan in #760
• add conda recipe for ipython by @benisraeldan in #764
• 0.4.0 version bump 🚀 by @ItayGabbay in #766

Full Changelog: 0.3.0...0.4.0

0.3.2

Commits

• 4c2752b: include_resources (#728) (JKL98ISR) #728

0.3.1

What's Changed

• Kaggle patch for plotly widgets by @JKL98ISR in #707
• add kaggle to allowed words + version bump by @JKL98ISR in #708

Full Changelog: 0.3.0...0.3.1

0.3.0

Deepchecks Version 0.3.0

Supported Environments

• Support running from non-jupyter environments - Suite outputs can be exported to html, and Check or Suite outputs can be exported to JSON for serialization. HTML export: #638, JSON export: #665
• Added support also for non-sklearn models. Supporting any model object that implements the predict method (and also predict_proba for classification), see supported models #594
• Fixed dependency warning when installing on google colab #577
• Fixed links from inside suite and check output to open in a new tab

Display and Output Improvements

• Output can be exported to html #638
• Suite output is now in a widget, enabling to browse quickly between checks, with and without conditions or display #610
• Distribution graphs smoothened, graphs looks better also when feature has outlier values #664
• Improved error handling. Checks that didn’t run due to irrelevant input (e.g. no index column) are no longer displayed as errors. #640

Docs

Improved documentation for many check examples:

• Trust Score
• Train Test Feature Drift
• Whole Dataset Drift
• Simple Model Comparison
• Single Feature Contribution
• Data Duplicates

Added documentation for export types:

• To HTML and To JSON

New Contributors

• @idow09 made their first contribution 🥳
• @BioGeek made their first contribution 🥳
• @shaypal5 made their first contribution 🥳

Maintainers

@matanper , @ItayGabbay , @yromanyshyn , @JKL98ISR , @benisraeldan , @deepchecks-bot , @shir22 , @nirhutnik , @noamzbr