Machine Learning, Simulation, Physics.
require small step sizes (learning rates) to work properly. However, as I mentioned in the previous article, first-order methods such as gradient descent are rarely used in physics simulations. Newton and quasi-Newton methods are more common and can converge faster in many cases. Unfortunately,