Machine Learning, Optimization, Differentiation, Neural Networks, Control.
several methods involved in computing derivatives of mathematical functions. Derivatives of mathematical functions form the part and parcel of an optimization solver. The Hessians or Jacobians of the objective and equality/inequality constraints form the basis for solving the underlying nonlinear