Dear ptrblck. Thanks your reply. I fix the problem by using weights. This is a stupid mistake. But I still do not very clear about this. So if I use the weights in forward method, then the Pytorch would include the weights in backward propagation and update their values?