Solved by Nikronic in post #2 
              
              
                Hi, 
This problem raises in two kind of situations: 

When you use inplace=True in your code and somehow regarding your model, backpropagation needs the values unchanged.
When you change a value like the image you have attached and backprop needs previously value again to compute gradient.

In the f…