Optimization

L-BFGS and CG
Unconstrained optimization. Function gradient is needed.

Levenberg-Marquardt algorithm
Unconstrained or boundary constrained optimization.

Bound and linear equality/inequality constrained optimization
Linearly constrained optimization.

Numerical optimization tips and tricks
Case studies for numerical optimization

About variable scaling
Discussion and examples

About preconditioning
Preconditioning strategies