Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
provide velocity to that ball and make it move faster. We do not want our ball to speed up so much that it misses the global minima, and hence β acts as friction. Let me introduce you to a few more optimization algorithms. RMSprop Consider the example of a simple gradient descent: Suppose we have