Thanks for your reply!~
I understand by this:
if I do tensor.cuda(), it will return a copy in GPU and this operation is differentiable( copybackward).
But if i do net.cuda() , the return value is self. So this operation is not differentiable( not  copy but just move?)
If i understand right ? There is difference between  tensor.cuda()   and net.cuda() ?