Normalized input (to [0, 1] or z-score) is usually beneficial for your training, i.e. your model might train faster and better.
However, in a segmentation use case you should be careful using ToTensor on your mask image, since this might destroy the labels.