Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When learning the Neural Net optimizes towards all negative output neurons #85

Open
jellespijker opened this issue Aug 18, 2015 · 6 comments
Assignees
Labels

Comments

@jellespijker
Copy link
Owner

The fitness routine has to be rewritten for the Genetic algorithms

latex_1d54fbc2610f7ea81bab9265f228f962

This results in a optimization function that hangs on a vector of all -1 or 1

@jellespijker jellespijker added this to the VSA GUI v1.0 finished milestone Aug 18, 2015
@jellespijker jellespijker self-assigned this Aug 18, 2015
@jellespijker
Copy link
Owner Author

Extra bonuses added to stimulate the population members that show a complete intersect with the goal vector and a bonus when the positive neuron intersects with the goal. The Bonus is a multiplication of the number of output neurons.

render

@jellespijker
Copy link
Owner Author

Implement issue #86 A revolution against the elite upperclass

@jellespijker
Copy link
Owner Author

The problem probably lies in the fact that the NN currently predicts either a -1 or a 1 in each neuron. This makes it virtually impossible to move incrementally towards an optimum.

Let the neurons fire a continuous value not just a step function.

@jellespijker
Copy link
Owner Author

Tricky f..in' function...
It convergences, but then it get stuck on 30 % error. I will park this and continue to work on it when I got reliable learning data.

One possible solution is to have two NNś one for the roundness and one for angularity.

@jellespijker
Copy link
Owner Author

It could be that issue #92 is related to this bug

@jellespijker
Copy link
Owner Author

Not related to issue #92

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant