Machine Learning, Optimization, Differentiation, Neural Networks, Control.
implementation of the fundamental building blocks of a nonlinear optimization solver which includes differentiation engine, linear algebra engine, numerics etc. In this article, specifically, I would like to discuss about the implementation aspects of the differentiation engine and discuss on the