Deep Learning, Optimization, Gradient Descent, Momentum, Learning Parameters.
carries it along. On a critical note, is moving fast always good? Would there be a situation where momentum would cause us to overshoot and run past our goal? Let test the MBGD by changing our input data so that we end up with a different error surface. Say this one shown above, where the error is