Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
idea here is to limit the capacity (the space of all possible model families) of the model by adding a parameter norm penalty, Ω(θ), to the objective function, J: Here, θ represents only the weights and not the biases, the reason being that the biases require much less data to fit and do not add