PyTorch optimizer based on nonlinear conjugate gradient method

A matlab function for steepest descent optimization using Quasi Newton's method : BGFS & DFP

Repository for machine learning problems implemented in python

Bespoke, from scratch, implementation of Armijo-Wolfe inexact line search technique to find step length for gradient descent optimisation. The library alternative is scipy.optimize.line_search

[Optimization Algorithms] Implementation of Nonlinear least square curve fitting using the Gauss-Newton method and Armijio’s line search.

Comparison of Gradient Descent and Block Coordinate Gradient Descent methods through a semi supervised learning problem.

This project is about the implementation of unconstrained optimization algorithms

Implementation of Trust Region and Gradient Descent methods for Multinomial Regression

This repository contains an implementation of the Gradient Descent Algorithm in C++, utilizing the Armijo condition to optimize step sizes.

some option technics within python and R