Stochastic Gradient, Machine Learning, AI, Gradient Descent.
MSE(w) + penalty (w) where penalty (w) is increasing the complexity of w. Thus a complex solution will be chosen over a simple solution only if it leads to a big decrease in the mean-squared error L₂ Regularisation There are many ways to define the penalty term. The most widely used one which has