If these parameters were updated in the past and if you are using an optimizer with internal running states for all parameters (e.g. Adam), this behavior is expected.
Here 5 is a small example.
Could this be the case, i.e. are you training these parameters and freezing them after some iterations?