Machine Learning, Optimization, Gradient Descent, Deep Learning, Learning Parameters.
Irrespective of where we start from, once we hit a surface which has a gentle slope, the progress slows down. Due to this, training methods could take forever to converge. Conclusion In this blog post, we made an argument to emphasize on the need of Gradient Descent using a toy neural network. We