Machine Learning, Neural Networks, Gradient Descent, Optimization, Data Science.
Gradient Descent (SGD), we consider just one example at a time to take a single step. We do the following steps in one epoch for SGD: Take an example Feed it to Neural Network Calculate it’s gradient Use the gradient we calculated in step 3 to update the weights Repeat steps 1–4 for all the