Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ResNet-32 architecture doesn't match ResNet paper #15

Open
j201 opened this issue Feb 12, 2020 · 0 comments
Open

ResNet-32 architecture doesn't match ResNet paper #15

j201 opened this issue Feb 12, 2020 · 0 comments

Comments

@j201
Copy link

j201 commented Feb 12, 2020

The hparams for ResNet-32 seem to define an input layer with 16 filters followed by stacks of layers with 32, 64, and then 128 filters:
https://github.com/for-ai/TD/blob/master/hparams/resnet.py#L12

This doesn't match the ResNet paper, which defines ResNet-32 with CIFAR-10 as having an input layer of 16 filters followed by stacks of layers with 16, 32, and 64 filters:

image

Also, the pruning code reports a total of 1 857 498 parameters, much more than the 0.46M reported in the paper. Changing hps.residual_filters to [16, 16, 32, 64] gives me a much closer value of 468 890 parameters.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant