Gradient Descent, Data Science, Data Visualization, Deep Learning, Machine Learning.
or a small subset of data points (also called mini batch) to compute the gradient. In SGD, the cost function is computed on a single data point, and the parameters of the model are updated accordingly. The process is repeated for all the data points in the dataset or a randomly selected mini-batch.