Hi Thomas,
Yes, I need it, otherwise I have the typical trying to backward through the graph a second time error. I have a loop where I update the canvas every timestep (forward pass), other variables might not change during the loop, like the target during the entire sequence or the windows during, say 5 timesteps, (then I recalculate the windows). But windows are just masks,
The algorithm works fine without this new loss I am trying to add, but as soon as I add it I get the error, very strange.