Solved by ptrblck in post #4 
              
              
                The parameters of MySmallModels are most likely missing in model.parameters(), since you are storing them in a plain Python list, thus the optimizer is ignoring them. 
Try to use self.networks = nn.ModuleList instead.