@ptrblck I realized there is only a slight reduce in speed and edited the question correspondingly. Therefore I conclude, that transforms.Normalize() cannot be used to normalize with matrices and so using standard numpy or PyTorch operations is the way to go. Sorry for the confusion.