condconv.pytorch

PyTorch implementation of Conditional Convolution in CondConv: Conditionally Parameterized Convolutions for Efficient Inference.

• CondConv layer and CondConv-equipped MobileNetV2 is supported (pre-trained model release is not in the recent plan).
• Dynamic batch inference is supported (implemented by group convolution).

Citation

@incollection{NIPS2019_8412,
title = {CondConv: Conditionally Parameterized Convolutions for Efficient Inference},
author = {Yang, Brandon and Bender, Gabriel and Le, Quoc V and Ngiam, Jiquan},
booktitle = {Advances in Neural Information Processing Systems 32},
editor = {H. Wallach and H. Larochelle and A. Beygelzimer and F. d\textquotesingle Alch\'{e}-Buc and E. Fox and R. Garnett},
pages = {1307--1318},
year = {2019},
publisher = {Curran Associates, Inc.},
url = {http://papers.nips.cc/paper/8412-condconv-conditionally-parameterized-convolutions-for-efficient-inference.pdf}
}

Note that there exist similar works, such as DY-CNN (accepted by CVPR'20) by Microsoft and DyNet (rejected by ICLR'20) by Huawei

@InProceedings{Chen_2020_CVPR,
author = {Chen, Yinpeng and Dai, Xiyang and Liu, Mengchen and Chen, Dongdong and Yuan, Lu and Liu, Zicheng},
title = {Dynamic Convolution: Attention Over Convolution Kernels},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2020}
}

@misc{
zhang2020dynet,
title={DyNet: Dynamic Convolution for Accelerating Convolution Neural Networks},
author={Kane Zhang and Jian Zhang and Qiang Wang and Zhao Zhong},
year={2020},
url={https://openreview.net/forum?id=SyeZIkrKwS}
}