Machine Learning, Optimization, Differentiation, Neural Networks, Control.
differences lie at the implementation level or to be more specific, the underlying data structure utilized for both the methods. According to the paper [4], the author proposes that typically a forward mode AD utilizes a directed acyclic graph (DAG) data structure and SD utilizes an expression tree