Could you initialize some parameters to a predefined values (e.g. -100) in your weight init method for the sake of debugging?
Then for each fold you could check this value and make sure your model was indeed re-initialized.
If you don’t see the expected value, then somehow your “old” model is still used.