Let’s say you execute the following code:
z = x + y
where x and y are Tensors. This should create a computation graph with a single “Add” node. But where in the PyTorch source code is this actually done?
Also, where exactly is this graph stored? We don’t initialize it ourselves. So it’s created behind the scenes?