Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the author of the activation function leaky tanh #843

Open
Junshuai1024 opened this issue Aug 23, 2023 · 2 comments
Open

Comments

@Junshuai1024
Copy link

I would like to ask you who came up with the activation function leaky tanh. I used the larq framework to experiment with binary networks and found it very effective. I have not found its author on the web and would like your help.

@CNugteren
Copy link
Contributor

Pinging @koenhelwegen as he has added this activation function to Larq in 2019 in #78.

@koenhelwegen
Copy link
Contributor

I thought this came from either the original STE paper or XNOR-net, but I don't see it there... Will have another look through the papers we were reading back then when I've time. In the meantime, perhaps @lgeiger do you have any recollection of where we came up with this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants