Linear Regression, Ridge Regression, Penalty, Loss, Cost Function.
Ordinary Least Squares (OLS) method as a starting point. The OLS method aims to minimize the SSR without any regularization. In OLS, the coefficient vector w is estimated by minimizing the SSR, which can be expressed as: minimize: SSR = ||y — Xw||² To derive the Ridge Regression coefficients, we