Machine Learning, Regularization, Linear Regression, Data Science, Overfitting.
case of simple linear regression with only one weight parameter w (the slope of the linear fit), their penalty terms look like this (including a scaling parameter λ): Lasso (L1): λ·|w| Ridge (L2): λ·w² Elastic Net (L1+L2): λ₁·|w| + λ₂·w² The different terms have different effects: Compared to L1,