Edit: solved!
Hi,
I did call model.eval() before manual calculation and model prediction.
When we run ‘model.eval()’ and predict, what BatchNorm layer statistics is used? Are running_mean and running_variance used at prediction?