Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
two parameters w and b as shown below: Look at the contour shown above and the parameters graph. We want to slow down the learning in b direction, i.e., the vertical direction, and speed up the learning in w direction, i.e., the horizontal direction. The steps followed in RMSprop can be summarised