Hi Allenye0119, Thank you reply very much, the part is too simple.
I search the internet cannot find a good document for it. I already did:
net = Net()
net.cuda()
forward + backward + optimize
    outputs = net(inputs).cuda()  <== should I touch it or leave it alone.

If you can, could you provide the guid how to modify http://pytorch.org/tutorials/beginner/blitz/cifar10_tutorial.html 11  to GPU trainingable
Thanks