tom:

You might be in for surprises when you do add them later


why?
What is the best way to leave out the parameters?  With means of param.requires_grad = False or leaving out in optimizer definition?
Thanks!