Solved by Brando_Miranda in post #3 
              
              
                From fmassa’s answer somewhere else (source: How does one make sure that the parameters are update manually in pytorch using modules?): 

Whenever we have an underscore in the end of a function in pytorch, that means that the function is in-place. 

If you you don’t know what in place means see alba…