Thanks @ptrblck
It worked pretty well, as I passed a loader that read the images according to my needs, and a custom transform that plays with the images the way I want. Needless to say that DatasetFolder is also a very nice option/alternative as one can pass the extensions of the files to load.