So…where should I place the BatchNorm layer, to train a great performance model?
(Not only linear layers model, but like CNN or RNN)


Between each layer?


Just before or after the activation function layer?


Should before or after the activation function layer?


And where I shouldn’t place the  BatchNorm  layer?