Hi,
You are correct indeed. The objects in the graph are now called Node though and not Function.
The reason why not all the graph is destroyed is that the graph itself is very small and on CPU memory so it should never be an issue. What gets freed is only the buffers which are the actual Tensors that use a lot of memory.