Overview of self-supervised learning of tiny models, including distillation-based methods (aks. self-supervised distillation) and non-distillation methods.
knowledge-distillation
self-supervised
binary-neural-networks
self-supervised-distillation
lightweight-models
tiny-models
small-models
-
Updated
Nov 13, 2022