Apparently, they’re registered automatically, using the fomrulation you are already using, see screenshot below. So, thats not the reason 
http://pytorch.org/docs/master/nn.html#containers 6 :

Screen Shot 2017-07-13 at 11.24.53 AM.png1594×682 67.5 KB