Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
practical by making an inexpensive approximation. In a simplistic view, dropout trains the ensemble of all sub-networks formed by randomly removing a few non-output units by multiplying their outputs by 0. For every training sample, a mask is computed for all the input and hidden units