Optimisers are the hammers that shape the models which perform miracles. They are the fundamental to Machine Learning and their research essential to building artificial intelligence. Advancement in optimisers benefits all and harms none. So why has the optimiser community had little effect on the overall progress of AI research in the past decade? why are we still where we were in 2014?

Adam optimiser (Kingma et al., 2014) has dominated in the arena of optimisers for neural networks, and no other algorithm has been able to come close to its wide applicability, speed, reliability and overall popularity. Many have tried to dethrone it but none have prevailed. Till now...

We at Dawn of Eve plan to build tools and resources to help dethrone Adam once and for all, and we plan to do so with the following repositories:

1. Awesome Optimisers: A repository built with love and care for Optimiser Researchers to speed up going from beginner to Godly optimally. Literature review should not hold you back anymore.
2. Nadir: A python library built on top of PyTorch for faster, bleeding edge, general purpose optimisers that can get you to the point of Nadir the fastest.
3. Deki : A library for creating beautiful and interactice visuals of optimisation paths of various optimisers. Because we belive that seeing is believing!
4. More coming soon, sit tight

Hey! if you are interested in the same, why don't you help us out?

There are a few ways you can help us:

1. ⭐ Star the repositories you liked! ⭐
2. Sponsor us! We try to work hard to get you the best of optimisers for no cost at all, but a coffee or a toffee would be quite motivating 😄
3. Make contributions to our repositories! All contributors are welcome and we would be delighted to have people help us.
4. Contact the maintainer to join the team, attend meetings and help build the Organisation from ground up with the Team Members. It is a commitment but we strongly believe we make the world a better place by optimising it (and having a lil' bit of fun along the way)

Here's a poem written for the demise of Adam:

Adam is Old
Adam is Tired
Adam has Back-Pain
Adam wants to Retire
~@bhavnicksm, 2022

Good thing @bhavnicksm is better at writting PyTorch code than Poems 😏