Pinned

1. adaptive-inertia-adai adaptive-inertia-adai Public

   [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum".

   Python 133 10

2. artificial-neural-variability-for-deep-learning artificial-neural-variability-for-deep-learning Public

   [Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neural Computation paper: Artificial Neural Variability for Deep…

   Python 35 4

3. stable-weight-decay-regularization stable-weight-decay-regularization Public

   [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.

   Python 55 4

4. Positive-Negative-Momentum Positive-Negative-Momentum Public

   [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.

   Python 27 6

5. deep-learning-dynamics-paper-list deep-learning-dynamics-paper-list Public

   This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and …

   218 22

6. Madaoer/S3IM-Neural-Fields Madaoer/S3IM-Neural-Fields Public

   [ICCV 2023] Pytorch implementation of "S3IM: Stochastic Structural SIMilarity and Its Unreasonable Effectiveness for Neural Fields".

   Python 225 9