Machine Learning, Artificial Intelligence, Regularization, Dropout Regularization, Overfitting.
overfit. Modified Loss with L2 regularization — Image by Author The constant lambda (≥0) is used to control the compromise between overfitting and underfitting. When lambda is high (low), the model tends to underfit (overfit). Let us consider the 2D case (n=2) where we can visualize the regression