Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
movement. Now as we take the weighted average the vertical movements which are actually in a direction opposite to each other for example 1 and 2, 3 and 4 are all opposite, this dampens the magnitude of movements in the vertical direction but the horizontal movement is same for all. So the