Machine Learning, Regularization, Linear Regression, Data Science, Overfitting.
the quadratic L2 regularization becomes negligible at small weights (close to zero), but stronger at large weights. This leads to the following behaviours, casually phrased: Linear Regression without regularization: “I go along with everything.” Lasso: “I’m skeptic at first, but go along with