i switched the model to eval() and used my train data loader to test the model on the training set to see if my problem is occurring on the training set also (got bad results on my training set) - which it did so i guess it’s not a normalization problem (which i thought at the beginning)
i’m using batch_size=64 for the training and for the eval phase
I even made sure that the layers weights are not updating in the eval mode.