Machine Learning, Gradient Descent, Stochastic Gradient, Batch Gradient Descent, Regression.
basically moving the system towards the global minimum of the averaged surface while SGD at every iteration chooses one data sample, which is one surface and moves on it (towards the negative gradient direction). To get an idea of how the parameters move in both the methods, Source: Batch , Mini