Machine Learning, Deep Learning, Stochastic Gradient, Data Science, Editors Pick.
time consuming, Memory required is proportional to the size of the dataset. Gradient Descent’s update rule is applied to all data points in the dataset, it all in one step. As the dataset increases this computation becomes much slower, so the time to convergence will increase. These computations