Machine Learning, Neural Networks, Gradient Descent, Optimization, Data Science.
former variants we saw. So, after creating the mini-batches of fixed size, we do the following steps in one epoch: Pick a mini-batch Feed it to Neural Network Calculate the mean gradient of the mini-batch Use the mean gradient we calculated in step 3 to update the weights Repeat steps 1–4 for the