Solved by ptrblck in post #3 
              
              
                I suppose you would like to upsample your image to the original size. If so, you could use ConvTranspose2d or Resize from torchvision. 
There are mixed results with both approaches. I think the original UNet implementation used ConvTranspose2d.