Solved by ptrblck in post #5 
              
              
                Modules or parameters in Python list and dict won’t be registered properly as such (and will thus be missing in e.g. model.parameters()). 
Use nn.ModuleList or nn.ModuleDict instead.