Solved by MariosOreo in post #3 
              
              
                Hi, 
I share something I known before with you, but I don’t know if it will help you. 
What I tried as follows: 
intermediate = torch.randn(1,3,3,3)
copy_intermediate = intermediate

print(id(intermediate))
print(id(copy_intermediate))
# the same id
print(intermediate is copy_intermediate))
# True

I…