Solved by KFrank in post #2 
              
              
                Hi Hmmm! 

Although _delay is a Parameter and potentially trainable, at a technical 
level, as soon as you call .item() on it you “break the computation graph,” 
as the result of .item() is no longer a pytorch tensor and therefore no 
longer participates in autograd. 
At a more conceptual level, you…