Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
updates ensure better predictions in the future. At test time, we combine the predictions of all the models. In the case of bagging with K models, this was given by the arithmetic mean. In case of dropout, the probability that a model is chosen is given by p(μ), with μ denoting the mask vector. The