Artificial Intelligence, Machine Learning, Deep Learning, Neural Networks.
length of the step only depends on the gradient or the slope at that particular point. It does not consider how the slope was at the previous step. It’s like a ball rolling down a slope, gaining speed as it rolls down Momentum Optimization introduces a moment vector ‘m’ and subtracts the slope x