Machine Learning, Simulation, Physics.
learning (SGD with momentum, RMSProp, Adam) already include additional state associated with momentum and automatically update it every time we run an optimization step, but the way momentum is implemented in these methods is not exactly how one would implement it for physics simulations. Keep in