Solved by tlim in post #6 
              
              
                Test (Nature images:  Intel Image Classification | Kaggle) 
Experiment 1.1: ImageNet Custom Stats vs None 
ResNet-18: 
 [resnet-18] 
ResNet-34: 
 [Screenshot from 2021-04-01 09-13-46] 
You can see the general trend being that the normalised experiments are slightly above the experiment without norma…