Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
should have been II shows descent for SGD. We can see that apart from the horizontal component a vertical component is developed. This vertical component is responsible for slowing things down. It is called Noise. 3. Mini Batch Gradient Descent: Here we divide the whole training data set into