Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deviations of this implementation from the original paper #13

Open
InnovArul opened this issue Aug 19, 2018 · 2 comments
Open

Deviations of this implementation from the original paper #13

InnovArul opened this issue Aug 19, 2018 · 2 comments

Comments

@InnovArul
Copy link

InnovArul commented Aug 19, 2018

I have come across the following main deviation between the paper(https://arxiv.org/abs/1710.09829) and the implementation of this repo:

In the paper: there are 32 primary capsule layer with 6x6 capsules each of 8 dimensions each. Hence, we needs to have 32 independent convolution layers with 8 output channels.
In the repo: it is implemented to be having 8 independent convolution layers with 32 output channels.

reference:

https://photos.app.goo.gl/FeCg4ejNdF3eVPvh6

https://github.com/cedrickchee/capsule-net-pytorch/blob/master/capsule_layer.py#L52

I have noticed this issue in another repo as well. I'm not sure if there is a misunderstanding in my interpretation of the paper.
gram-ai/capsule-networks#23

Can you please check and comment on this?

@nabsabraham
Copy link

This is a good question! I wonder if it has to do with weight sharing? It says in the paper that "each capsule in the [6 × 6] grid is sharing their weights with each other" so I'm wondering if its only per capsule dimension. Any input is useful! This is just my conjecture

@InnovArul
Copy link
Author

InnovArul commented Dec 11, 2018

I believe the sharing of weights in [6 x 6] grid is achieved by default due to the use of Convolution layer with 8 dimensions (Channels). Don't you think so?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants