Machine Learning, Optimization, Differentiation, Neural Networks, Control.
is a vector, then the Jacobian is a matrix). The second order methods require the aforementioned information of the first order methods and as well as the Hessians of the mathematical functions a.k.a. second order derivatives (predominantly the Hessian of the objective function). Thus, in order to