Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
value Continue doing step 2 and 3 till loss function gets minimized Learning rate defines the size of steps we take to reach the minimum. In other words, it controls how fast or slow should we converge to the minimum. Can we come up with a better update rule? To understand the gradient descent