MERAH_Samia:

to a form of approximate Bayesian inference and a network trained with dropout already is a Bayesian neural network,


Hi, regarding your two statements -

Yes as per Yarin Gal et al https://arxiv.org/abs/1506.02142 50, you could interpret training a neural net with dropout as conducting Bayesian inference.
A Bayesian neural net is one that has a distribution over it’s parameters. Using dropout allows for the effective weights to appear as if sampled from a weight distribution. If you were to remove the dropout layer, then you’d have point estimates which would no longer correspond to a bayesian network.