Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
output distributions. In such a case, we’d expect the parameters for both the models to be similar to each other as well. We could impose a norm penalty on the distance between the weights, but a more popular method is to force the set of parameters to be equal. This is the essence behind Parameter