Solved by justusschock in post #3 
              
              
                Conv Transpose is the inverse of Conv, it works somehow like a convolution, while maxunpool only repeats your pixels to achieve the right output shape. Rather than maxunpool I would use torch.nn.interpolate if you dont want some trainable parameters and conv transpose if you want some