Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
gradient descent, the updates will look like: One more way could be to use a larger learning rate. But that could result in large upgrade steps, and we might not reach global minima. Additionally, too small a learning rate makes the gradient descent slower. We want a slower learning in the vertical