Solved by mratsim in post #4 
              
              
                Yes, CNNs learn best with pixel values / 255 
Furthermore you also probably should normalize by channel so that your values distribution is centered around 0 and standard deviation is 1. 
Here is a script to do that for PyTorch. 
Note: for pretrained network on ImageNet you should use ImageNet mean …