Solved by ptrblck in post #8 
              
              
                Yes, the inplace updates of parameters are raising an error now, if you are using stale gradients as described in the 1.5 release notes (described in the torch.optim optimizers changed to fix in-place checks for the changes made by the optimizer section). 
The reason is that the gradient computation…