Solved by ptrblck in post #6 
              
              
                If the initialization adaption didn’t help, you could try to load the Keras parameters into the PyTorch model and make sure the same (random) input creates the same outputs. 
If that’s the case, the difference should come from the preprocessing.