Screen Shot 2017-08-20 at 12.56.06 AM.png2518×738 267 KB

Here (red) from conv5 to conv6 the height, width is becoming from (75,75) to (38,38) due to conv2d with kernel size 3, stride = 2, padding =1. I give this output as skip connection when decoding (yellow part). backblock with size (1,256,75,75) corresponds to output of conv6 which is given to deconv1 with (1,128,76,76) as skip connection. Due to eariler convTranspose2d layer with kernel size 4, stride =2,padding=1, the height, width become from (38,38) to (76,76). Resulting in dimension mismatch with skip connection. How can I resolve this issue?