Solved by ptrblck in post #2 
              
              
                Upsample will use the mode to “mathematically” upsample the activation (no training), while ConvTranspose2d will use trainable filter kernels.