Machine Learning, Optimization, Differentiation, Neural Networks, Control.
solve a nonlinear optimization problem using either first or second order methods, the computation of derivatives becomes an indispensible tool. The simplest way to compute the derivatives of the mathematical functions is to jot down the derivatives by using the basic rules of calculus and