Solved by SimonW in post #2 
              
              
                use ModuleList instead of python list https://pytorch.org/docs/master/nn.html#modulelist. pytorch can’t know about things you hide in a plain list.