Make sure to flip the conv kernels, as Lasagne performs a real convolution while mostly all other frameworks perform a cross-correlation.
Also, have a look at this code 16 where I’ve ported the ProgGAN Lasagne model to PyTorch.
Maybe this will be helpful.