Machine Learning, Neural Networks, Gradient Descent, Optimization, Data Science.
It converges faster when the dataset is large as it causes updates to the parameters more frequently. Mini Batch Gradient Descent We have seen the Batch Gradient Descent. We have also seen the Stochastic Gradient Descent. Batch Gradient Descent can be used for smoother curves. SGD can be used when