Well, images are loaded in torchvision using PIL. So basically all formats are supported as long as you can use a library to load the data.
rawpy 2 seems to be able to handle raw image data.
You would need to create your own Dataset and write the code to read and process the images in __getitem__ or alternatively you could write a loader and pass it to torchvision.datasets.ImageFolder.