Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
weighted-average method to stabilize the vertical movements and also the problem of the suboptimal state. If we see the image we will see that, it shows the noisy movements introduced in the descent. Now if we decompose each movement we will get two components, the right movement, and the vertical