The difference is most likely coming from the limited floating point precision.
However, if I understand the issue correctly, you were able to get exactly the same results before trying to fine tune the model? If that’s correct, what exactly did you change for the fine tuning run?