Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
regularization term which makes sure that small perturbations in the weight values don’t affect the predictions much, thus stabilising training. Sometimes we may have the wrong output labels, in which case maximizing p(y | x)may not be a good idea. In such a case, we can add noise to the labels by