Hi, I have a quick question about parameters passed into the optimizer.
I knew that only the parameters assigned in the optimizer were updated by gradients, but after the optimizer was defined and start training, I make the parameters that were not assigned to the optimizer to compute gradient(requires_grad=True), which caused a huge change in performance.
In this situation, does the parameter not assigned to the optimizer updated? All does that parameter affects other assigned parameter when updating?