Machine Learning, Neural Networks, Statistics, Data Science, AI.
on the training data. In the words of Tim Roughgarden, we become “biased toward simpler models, on the basis that they are capturing something more fundamental, rather than some artifact of the specific data set”. Figure 2: Applying regularization can help prevent overfitting on the training data