What do you mean by



 pchalasani:

I should mention that I override the model.parameters() function to return an array of two specific parameters (because my model does some custom stuff that is not in any of the standard layers).


?
The optimizer will only update the parameters that are passed in the constructor, and if model.parameters() do not return all the parameters, then it won’t update the parameters that are not returned.