Hi,
In the dropout paper 24, the probability p stands for optimal probability of retention. i.e. p=1 means keep all activations.
In PyTorch, it’s the opposite. p stands for probability of an element to be zeroed. i.e. p=1 means switch off all activations.
Why the difference?