Skip to content

v0.15 Self-Supervised training support

Compare
Choose a tag to compare
@ebursztein ebursztein released this 21 Jan 19:28
· 533 commits to master since this release

This release add self-supervised training support

Added

  • Refactored Augmenters to be a class
  • Added SimCLRAugmenter
  • Added SiamSiamLoss()
  • Added SimCLR Loss
  • Added ContrastiveModel() for self-supervised training
  • Added encoder_dev() metrics as suggested in SiamSiam to detect collapsing
  • Added visualize_views() to see view side by side
  • Added self-supervised hello world narrated notebook
  • Refactored Augmenter() as class.

Changed

  • Remove augmentation argument from architectures as the augmentation arg could lead to issues when saving the model or training on TPU.
  • Removed RandAugment which is not used directly by the package and causes issues with TF 2.8+