Optimization, Learning Parameters, Gradient Descent, Stochastic Gradient, Deep Learning.
gradient descent. Mini-Batch Gradient Descent In the case of mini-batch, instead of making an update with gradients of one data point at a time, we calculate gradients of a batch of data points, of size, say k. Let’s look at the code of MBGD. Notice that the algorithm updates the parameters after