Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
with reprojection (to the corresponding ball), prevent the weights from becoming too large, thus, maintaining stability. A final suggestion made by Hinton was to restrict the individual column norms of the weight matrix rather than the Frobenius norm of the entire weight matrix, so as to prevent