Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bias should be added to input layer #45

Open
ErikSchulze1796 opened this issue Jan 3, 2022 · 4 comments
Open

Bias should be added to input layer #45

ErikSchulze1796 opened this issue Jan 3, 2022 · 4 comments

Comments

@ErikSchulze1796
Copy link

Hello Alex,

I am fairly new to the field of machine learning and found your awesome tool for NN visualization during my research. One thing that came to my mind when ticking the "Show bias button" is that the bias is not added to the input layer, or am I wrong? I get that the input features are no "real" layer but shouldn't be the bias added to the input of each neuron of each layer after the input layer, or am I wrong?

Greetings from Germany!
Erik

@alexlenail
Copy link
Owner

Hi @ErikSchulze1796

Bias in the input layer is represented. It's less obvious which node is the bias in the input layer -- it could be any of them - since what distinguishes a bias unit in subsequent layers is the absence of inputs from the previous layer, but none of the units in the input layer get inputs from a previous layer because there isn't a previous layer.

Maybe we should be explicitly coloring the bias unit gray or something..

@ErikSchulze1796
Copy link
Author

Oh yes, I see it now. You're completely right. It was just a bit confusing since it was not directly distinguishable from the other nodes. Thanks for the quick answer!

@tirtho109
Copy link

Hi @alexlenail, Thanks for the clarification. But still I have some doubt. From my understanding, bias should not be considered as a dimension of a particular layer. Please let me know, if I got it wrong? Show Layer Labels should give one less dimension for each layer. Thanks!

@alexlenail
Copy link
Owner

@tirtho109 that's a good point. When the bias units are drawn the layer labels should be updated as well -- good catch. I'll gladly accept a PR for this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants