Skip to content

myc159/Deep-Taylor-Decomposition

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Deep Taylor Decomposition

This implementation codes are specifically designed to see the visual result of deep taylor decomposition, a novel saliency mapping methods for deep neural network, applied at ImageNet pretrained models such as vgg or resnet.

Abstract - Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods perform impressively well, they have a significant disadvantage, the lack of transparency, limiting the interpretability of the solution and thus the scope of application in practice. Especially DNNs act as black boxes due to their multilayer nonlinear structure. In this paper we introduce a novel methodology for interpreting generic multilayer neural networks by decomposing the network classification decision into contributions of its input elements. Although our focus is on image classification, the method is applicable to a broad set of input data, learning tasks and network architectures. Our method is based on deep Taylor decomposition and efficiently utilizes the structure of the network by backpropagating the explanations from the output to the input layer. We evaluate the proposed method empirically on the MNIST and ILSVRC data sets. - https://arxiv.org/abs/1512.02479

Results

vgg16bn-ImageNet pretrained

origin1 vgg16bn_1 origin2 vgg16bn_2 origin3 vgg16bn_3
origin4 vgg16bn_4 origin5 vgg16bn_5 origin6 vgg16bn_6

vgg19-ImageNet pretrained

origin1 vgg19_1 origin2 vgg19_2 origin3 vgg19_3
origin4 vgg19_4 origin5 vgg19_5 origin6 vgg19_6

resnet34-ImageNet pretrained

origin1 res34_1 origin2 res34_2 origin3 res34_3
origin4 res34_4 origin5 res34_5 origin6 res34_6

resnet101-ImageNet pretrained

origin1 res101_1 origin2 res101_2 origin3 res101_3
origin4 res101_4 origin5 res101_5 origin6 res101_6

Future Work

  • Densenet pretrained model version will be updated soon.
  • Batch normalization layer need some modification.

About

DTD implement on Imagenet pretrained model

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages