Machine Learning, Neural Networks, Statistics, Data Science, AI.
when SGD was used for neural networks, which saw their resurgence in the era of big data. Thinking of the term from the perspective of a single example, consider the regularization term without such scaling: A term that might had the weight of a 1000 examples in some of the first problems tackled