Skip to content

MingtaoGuo/Summary-of-deep-learning-papers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 

Repository files navigation

Summary of deep learning papers

Summarize some interesting paper about computer vision

Image Classification Methods

☀️ (LeNet)[Gradient-based learning applied to document recognition] [Paper]

☀️ (AlexNet)[ImageNet Classification with Deep Convolutional Neural Networks] [NIPS 2012][Paper][Code]

☀️ (VGGNet)[Very Deep Convolutional Networks for Large-Scale Image Recognition] [arXiv][Paper][Code]

☀️ (GoogLeNet)[Going deeper with convolutions] [CVPR 2015][Paper][Code]

☀️ (ResNet)[Deep Residual Learning for Image Recognition] [CVPR 2016][Paper][Code]

☀️ (ResNeXt)[Aggregated Residual Transformations for Deep Neural Networks] [CVPR 2017][Paper][Code]

☀️ (DenseNet)[Densely Connected Convolutional Networks] [CVPR 2017][Paper][Code]

☀️ (Inception-v4)[Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning] [AAAI 2017][Paper][Code]

☀️ (Inception-v3)[Rethinking the Inception Architecture for Computer Vision] [CVPR 2016][Paper][Code]

☀️ (Xception)[Xception: Deep Learning with Depthwise Separable Convolutions] [CVPR 2017][Paper][Code]

☀️ (ShuffleNet)[ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices] [arXiv][Paper][Code]

☀️ (MobileNets)[MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications] [arXiv][Paper][Code]

☀️ (SENet)[Squeeze-and-Excitation Networks] [CVPR 2018][Paper][Code]

Normalization Methods

🌔 (Batch Normalization)[Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift] [ICML][Paper]

🌔 (Instance Normalization)[Instance Normalization: The Missing Ingredient for Fast Stylization] [arXiv][Paper][Code]

🌔 (Layer Normalization)[Layer Normalization] [arXiv][Paper]

🌔 (Group Normalization)[Group Normalization] [arXiv][Paper][Code]

🌔 (Switchable Normalization)[Differentiable Learning-to-Normalize via Switchable Normalization] [arXiv][Paper][Code]

🌔 (Instance-Batch Normalization)[Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net] [arXiv][Paper][Code]

Activation Functions

⭐ (ReLU)[Rectified linear units improve restricted boltzmann machines] [ICML][Paper]

⭐ (Noisy ReLU)[Deep Belief Networks on CIFAR-10] [arXiv][Paper]

⭐ (Leaky ReLU)[Rectifier Nonlinearities Improve Neural Network Acoustic Models] [ICML 2013][Paper]

⭐ (eLU)[Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)] [arXiv][Paper]

⭐ (SeLU)[Self-Normalizing Neural Networks] [NIPS 2017][Paper][Code]

⭐ (PReLU)[Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification] [ICCV 2015][Paper]

⭐ (Maxout)[Maxout Networks] [JMLR 2013][Paper]

⭐ (Swish)[Searching for Activation Functions] [arXiv][Paper]

Generative Adversarial Networks Theory

🌼 (GAN)[Generative adversarial nets] [NIPS 2014][Paper][Code]

🌼 (cGAN)[Conditional Generative Adversarial Nets] [arXiv][Paper][Code]

🌼 (DCGAN)[Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks] [arXiv][Paper][Code]

🌼 (LAPGAN)[Deep generative image models using a Laplacian pyramid of adversarial networks] [NIPS 2015][Paper][Code]

🌼 (Semi-Supervised GAN)[Improved Techniques for Training GANs] [NIPS 2016][Paper][Code]

🌼 (Info GAN)[InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets] [NIPS 2016][Paper][Code]

🌼 (LSGAN)[Least Squares Generative Adversarial Networks] [ICCV 2017][Paper][Code]

🌼 (WGAN)[Wasserstein Generative Adversarial Networks] [ICML 2017][Paper][Code]

🌼 (WGAN-GP)[Improved Training of Wasserstein GANs] [NIPS 2017][Paper][Code]

🌼 (EBGAN)[Energy-based Generative Adversarial Network] [arXiv][Paper][Code]

🌼 (BEGAN)[BEGAN: Boundary Equilibrium Generative Adversarial Networks] [arXiv][Paper][Code]

🌼 (PG-GAN)[Progressive Growing of GANs for Improved Quality, Stability, and Variation] [arXiv][Paper][Code]

🌼 (SNGAN)[Spectral Normalization for Generative Adversarial Networks] [arXiv][Paper][Code]

🌼 (DRAGAN)[On Convergence and Stability of GANs] [arXiv][Paper][Code]

🌼 (Relativistic GAN)[The relativistic discriminator: a key element missing from standard GAN] [arXiv][Paper][Code]

🌼 (cGAN with projection disc)[cGANs with projection discriminator] [arXiv][Paper][Code]

🌼 (BigGAN)[Large Scale GAN Training for High Fidelity Natural Image Synthesis] [arXiv][Paper][Code]

🌼 (SAGAN)[Self-Attention Generative Adversarial Networks] [arXiv][Paper][Code]

Image-to-Image Translation

🐛 (pix2pix)[Image-to-Image Translation with Conditional Adversarial Networks] [CVPR 2017][Paper][Code]

🐛 (pix2pixHD)[High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs] [CVPR 2018][Paper][Code]

🐛 (CycleGAN)[Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks] [ICCV 2017][Paper][Code]

🐛 [Unsupervised Attention-guided Image to Image Translation] [arXiv][Paper][Code]

🐛 (DiscoGAN)[Learning to Discover Cross-Domain Relations with Generative Adversarial Networks] [ICML 2017][Paper][Code]

🐛 (UNIT)[Unsupervised Image-to-Image Translation Networks] [NIPS 2017][Paper][Code]

🐛 (MUNIT)[Multimodal Unsupervised Image-to-Image Translation] [arXiv][Paper][Code]

🐛 (BicycleGAN)[Toward Multimodal Image-to-Image Translation] [NIPS 2017][Paper][Code]

🐛 (StarGAN)[StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation] [CVPR 2018][Paper][Code]

🐛 (RecycleGAN)[Recycle-GAN: Unsupervised Video Retargeting] [ECCV 2018][Paper][Code]

Style Transfer

🐳 (Gatys)[A Neural Algorithm of Artistic Style] [Paper]

🐳 (Johnson)[Perceptual Losses for Real-Time Style Transfer and Super-Resolution] [Paper]

🐳 [Universal Style Transfer via Feature Transforms] [Paper]

🐳 [Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization] [Paper]

🐳 [Visual attribute transfer through deep image analogy] [Paper]

🐳 [Arbitrary Style Transfer with Deep Feature Reshuffle] [Paper]

🐳 [Artistic style transfer for videos] [Paper]

🐳 [Characterizing and Improving Stability in Neural Style Transfer] [Paper]

🐳 [Controlling Perceptual Factors in Neural Style Transfer] [Paper]

🐳 [Deep Photo Style Transfer] [Paper]

🐳 [Fast Patch-based Style Transfer of Arbitrary Style] [Paper]

🐳 [Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis] [Paper]

🐳 [Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer] [Paper]

🐳 [StyleBank: An Explicit Representation for Neural Image Style Transfer] [Paper]

🐳 [CartoonGAN: generative adversarial networks for photo cartoonization] [Paper]

🐳 [Visual Attribute Transfer through Deep Image Analogy] [Paper]

🐳 [A learned representation for artistic style] [Paper]

Face Attribute Manipulation

👽 [Deep Feature Interpolation for Image Content Changes] [Paper]

👽 [Autoencoding beyond pixels using a learned similarity metric] [Paper]

👽 [Convolutional Network for Attribute-driven and Identity-preserving Human Face Generation] [Paper]

👽 [Deep Identity-aware Transfer of Facial Attributes] [Paper]

👽 [Learning Residual Images for Face Attribute Manipulation] [Paper]

👽 (StarGAN)[StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation] [Paper]

Image Inpainting

👀 [Context Encoders: Feature Learning by Inpainting] [Paper]

👀 [Semantic Image Inpainting with Deep Generative Models] [Paper]

👀 [High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesis] [Paper]

👀 [Globally and locally consistent image completion] [Paper]

👀 [Generative Image Inpainting with Contextual Attention] [Paper]

Super Resolution

🐂 [Image Super-Resolution Using Deep Convolutional Networks] [Paper]

🐂 [Enhanced Deep Residual Networks for Single Image Super-Resolution] [Paper]

🐂 [Residual Dense Network for Image Super-Resolution] [Paper]

To be continued.

About

Collecting some interesting papers about computer vision

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published