Solved by Oli in post #2 
              
              
                Edit: Think I got it wrong the first time. This time I’m concating asap in the UpConv and changed the out_channels in all the UpConv layers so it matches the kernel size from the picture (Kernel / Pool size). Also changed the order in the UpConv forward function. I haven’t doublechecked but let me k…