oh, I guess it is confusing because I do not see multiplication. Do you know where add_ function is defined? However it is probably not that important for me. Just when I use PyCharm “go to declaration” it brings me to empty declaration. So the definition is lost somewhere in class hierarchy.
I guess weights are stored in  p, right?
Is there a way to tell what layer weight is currently being updated?
Say I have 3 layers, how do I know what weights are updated at any point?
E.g I want to do something with grad before it is used for weights update, but my action depends on a layer