loss isn’t a parameter but it is computed, so you don’t need to save it except for informational purposes.
It would be expected that the loss is different after loading and running the model again, just like it would be if you had run the original model right after saving it.
Best regards
Thomas