You could use torchvision.transforms.ToPILImage() to transform the numpy arrays to PIL.Images, apply all image transformations, and convert it to a tensor via ToTensor().
The same approach is used in e.g. in the MNIST 9 dataset, since the data is directly into memory.