Yeah I know, but in my case, my tensor t is like a helper tensor that is independent to input. So if I create a new one at each forward pass, then I also need to run function assign_values(t) each time, which will take some time.
On the other hand, if I am able to re-use gpu memory, then I only need to call assig_value(t) once