Machine Learning, Optimization, Differentiation, Neural Networks, Control.
differentiation The last category, literally from its definition it is evident that the derivatives are approximated using some simple mathematical tricks (e.g. the imaginary trick [1]) or simply by the mathematical definition of a derivative. The following example illustrates a simple way to