Solved by Mazhar_Shaikh in post #2 
              
              
                Hi John_Deterious, 
This is safe. As long as y1 and y2 are retained in the memory, the graphs remain. It will be destroyed if you delete the tensors. Calling backward also destroys the graph, unless called with the “retain_graph=True” argument.