Ok,Thanks too much, but I have another question. when one require_grad of Parameter is false, layers before it will not backpropogate? Is it right?  I am confused about the meaning of require_grad.  Could You help me explain it?