Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
as we use the same batch over each time, the distribution of the set does not change and so the weight distribution also remains similar on each update. If we visualize the descent, it will look something like this. For a higher dimension of weights, we represent as contours. The first graph shows