Machine Learning, Gradient Descent, Optimization, Deep Learning, Artificial Intelligence.
minima. The rate of Gradient Descent is mainly determined by the learning rate parameter and optimal learning rate needs to be determined. Having high learning rate causes the optimization problem to converge and having low learning rate would be costly both in time and computational resources. To