Machine Learning, Artificial Intelligence, Regularization, Dropout Regularization, Overfitting.
function is modified as follows Modified Loss with Entropy regularization — Image by Author Since we want the output probabilities to have a certain degree of uncertainty in them, which means we want to increase the entropy. Since we are decreasing the loss, using entropy in the loss function,