Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
penalties naturally impose a constraint, like the L²-regularization, defining a constrained L²-ball. Larger α implies a smaller constrained region as it pushes the values really low, hence, allowing a small radius and vice versa. The idea of constraints over penalties is important for several