Stochastic Gradient, Machine Learning, AI, Gradient Descent.
many names: Ridge regression, L₂ regularisation, or Tikhonov regularisation. These all mean that we set penalty(w) = λ || w||²₂ Where λ is a positive hyperparameter, a configuration that allows you to trade-off smaller MSE (preferred for small λ) versus smaller model complexity (preferred for