Thanks for the response
I guess it does make some sense that way, but those parameters would have to be changed before the model(input) instruction, or while that instruction is being evaluated, I guess.
Also not sure if the parameters should not be reverted back before calling backward(), though, would that not have an impact on the gradient calculation?