Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
making the greedy decision and updates the parameters best suitable for that point alone which may be the case for the remaining points. We can reduce the problem of oscillations is by considering a subset of data or batch of data and update the parameters after calculating the derivates for each