Solved by albanD in post #6 
              
              
                Your Tensor self.w is defined once during the init and then re-used for every forward in the forward method. 
So if you add a hook to that Tensor, it will be taken into account at every forward as the Tensor is re-used at every forward. 
In your code above, if you register the hook on out you won’t …