I think this was just :

To showcase the power of PyTorch dynamic graphs

In practice, this has no sense to me. The weights should be updated by the optimizer and typically they are different in each step.