Is the usage of a DataLoader completely impossible? If not, you could probably hide the transform times into the GPU execution of your training procedure.
Anyway, if you need to work in a sequential manner, you might want to save your preprocessed tensors onto your drive and load it for training. Would that be possible or do you need other image processing ops than normalization?