So I am using resnet + unet as found here https://github.com/usuyama/pytorch-unet/blob/master/pytorch_resnet18_unet.ipynb 6
My total dataset contains around 5000-6000 images being around 14 gb at original resolution, but I rescale them at runtime.