Solved by albanD in post #6 
              
              
                This refers to every part of the graph that were visited during the backward pass. 

Yes only gradient computation in this case. 
Be careful if playing with super simple example, you can create simple graphs that don’t have any buffer or intermediary result and so you will be able to backprop throu…