Improve test_pt_tf_model_equivalence on PT side
# What does this PR do?

Same as in #16557, but on PT test side.

Now we only have 2 `def test_pt_tf_model_equivalence` in the common test files 💯 
_The documentation is not available anymore as the PR was closed or merged._<|||||>Merged (after a rebase)