Multi-fidelity Neural Architecture Search with Knowledge Distillation Run NAS.ipynb to study the benchmark and NAS algorithms. mobilenetv2.py, ShuffleNetv2.py define search spaces. Training with various KD methods were done via https://github.com/HobbitLong/RepDistiller.