If training is different, the computation of gradients is probably different, assuming you’re using the same optimizer.
Can you check if your gradients (or the output) is different? Are there any random parts to your model (random initialization, etc?) Weights to nn layers are usually randomly initialized.