Do you need to necessarily pad the images. If you want to make all the data in same size you can use image resizing.
For doing this all you need to do is create custom data loader and resize the loaded image and return as input.