Hi all,
I have a question for you. Do you know if it is possible to add dropout layers to an already trained neural network? I have a model trained without dropout, but I want to use dropout at inference time to estimate uncertainty.
I managed to copy the weights from my trained model into a model with dropout layers, but predictions are messed up. This is probably because in PyTorch when dropout is set in train mode it will divide the weights by 1-p.
Do you know if there is any way to deal with this issue? Or it is simply wrong to add dropout to an already trained model without retraining it?
Thanks in advance for your help