Solved by albanD in post #2 
              
              
                Hi, 
You can check the release note for 1.5. In particular the part about fixing the inplace detection code for the optimizer.step() functions for the builtin optimizers. 
The issue you have is that the optimizer.step() modifies the weights inplace. But if these weights are needed to compute the bac…