It seems that your training might just be stuck, so that you would have to play around with some hyperparameters or was the model training better without the normalization?
Also, is there a particular reason you are reimplementing the Normalize method instead of using torchvision.transforms.Normalize?