Thanks for the update.
So based on the description of both cases: sometimes loading the model returns the expected values, other times it doesn’t.
Could you post the model architectures as well as the code to save and load the models?