Hi @apaszke, still a little uncertain about the part where you say:

the reference to the loss from the previous iteration won’t be overwritten … until this iteration completes.

Can you elaborate on that piece a little more?