Solved by chenyuntc in post #2 
              
              
                There are learnable parameters in nn.ConvTranspose2d while nn.Upsample not. 
It’s something like the difference between nn.Conv2d and nn.AvgPool2d.