Solved by J_Johnson in post #2 
              
              
                Please see here: 
https://pytorch.org/docs/stable/notes/autograd.html 

In-place operations with autograd
Supporting in-place operations in autograd is a hard matter, and we discourage their use in most cases. Autograd’s aggressive buffer freeing and reuse makes it very efficient and there are very …