Thanks for the quick reply!  I was not able to get any of those things to work.

“Don’t accumulate history across your training loop.”

This is not data accumulation.  These are both Variables that need to have a gradient calculated.  Calling .data on anything in the loop gives me problems with Tensor/Variable math, warnings because of returning a Tensor instead of a Variable in forward(), or warning that backward() has nothing to compute a variable for.

“Don’t hold onto tensors and variables you don’t need.”

If this is the problem I’m not sure where I’m supposed to delete.  var1 is what gets returned at the end of forward so I assume that gets cleaned up elsewhere?  Deleting var2 after its used does not make a difference in memory loss.