To compare both model implementations you could pass a constant input to them (e.g. all ones) and compare the final (and intermediate outputs).
Of course you would need to load the same state_dicts in both models to make sure that you are using the same parameters.
This approach would allow you to isolate if and where the difference in the models comes from.