Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
the gradient movement in a 2d plane. The second graph shows the gradient movement for a complex function shown using contours and the third graph shows the convergence of the loss function. So, we can see that gradient descent is pretty smooth and loss function converges quickly. Here in the case