Skip to content
This repository has been archived by the owner on Mar 17, 2021. It is now read-only.

Implement FixUp Layer #460

Open
danieltudosiu opened this issue Nov 4, 2019 · 0 comments
Open

Implement FixUp Layer #460

danieltudosiu opened this issue Nov 4, 2019 · 0 comments
Assignees
@danieltudosiu

Comments

@danieltudosiu
Copy link
Contributor

danieltudosiu commented Nov 4, 2019 •
edited

Implementing FixUp initialization [1] based convolutional layer as it allows one to train without normalization.

[1] Zhang, Hongyi, Yann N. Dauphin, and Tengyu Ma. "Fixup initialization: Residual learning without normalization." arXiv preprint arXiv:1901.09321 (2019).
@danieltudosiu danieltudosiu self-assigned this Nov 4, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@danieltudosiu danieltudosiu

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@danieltudosiu