The code below should be clear.
t = some_cpu_tensor
t.cuda()
# here t is not on the the gpu

t = some_cpu_tensor
tc = t.cuda()
# here tc is on the the gpu

t = some_cpu_tensor
t = t.cuda()
# here t is on the the gpu