Solved by ptrblck in post #3 
              
              
                If you would like to store modules in a list, use nn.ModuleList, so that the modules will be properly registered inside the parent module.