Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for maximum/minimum weight parameter #48

Open
satunheim opened this issue Sep 26, 2023 · 0 comments
Open

Request for maximum/minimum weight parameter #48

satunheim opened this issue Sep 26, 2023 · 0 comments

Comments

@satunheim
Copy link

During testing of a hardware implementation of a Convolutional Coalesced TM – for MNIST – I found that setting a maximum/minimum value of the signed weights could give a boost in test accuracy, compared to training with no weight restrictions. In hardware such a limitation is required as a fixed number of bits per weight has to be allocated.

Typically, the weight limit would be rather small compared to the number of clauses and T, and this seems to be beneficial for the performance. It might affect the training time though.

It would be very useful and interesting if such a parameter could be included.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant