Solved by ptrblck in post #2 
              
              
                To compare both model implementations you could pass a constant input to them (e.g. all ones) and compare the final (and intermediate outputs). 
Of course you would need to load the same state_dicts in both models to make sure that you are using the same parameters. 
This approach would allow you to…