Deep Learning, Optimization, Gradient Descent, Momentum, Learning Parameters.
clicking on the kicker tag at the top of this post. In part-1, we saw a clear illustration of a curve where the gradient can be small in gentle regions of the error surface, and this could slow things down. Let’s look at what momentum has to offer overcome this drawback. Citation Note: Most of the