Machine Learning, Optimization, Differentiation, Neural Networks, Control.
implementation [5] of forward mode AD and this applies the other way round too. In such a case, this leads to a phenomenon known as expression swell which slows down the derivatives computation and the expression evaluation. As an example, consider the following mathematical expression Fig2. f is