Linear and Nonlinear Optimization

This repo contains a compilation of Optimization Related Coding

Unconstrained

Least-Squares, Regularized Least-Squares, Newton's Method, Convergence of NM, Secant Method, Gradient Descent (Steepest Descent), Optimality and Convexity, Linear Search Methods, Quasi-Newton

Constrained

Linear Programming, Feasibility, KKT, Langrangian Duality, Simplex Method, Interior-Point Method, Quadratic Programming