Hi,
I’m playing with the MC dropout (Yarin Gal) idea which inserts a dropout layer after every weight layer. But for many pretrained models like ResNet, they are using BatchNorm instead of dropout. So does it still make sense to use have both dropout and batchnorm in those models at the same time? Is there a reason why dropout is not used anymore in recent architecture designs?
Thanks!