Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
take a million calculations (compute derivates for each of the million points and accumulate all these derivates) and then make one tiny update to our parameters. Can we do Something better? Instead of looking at all data points at one go, we will divide the entire data into a number of subsets.