I found one more thread - When should I use nn.ModuleList and when should I use nn.Sequential? 29
Here you said

Exactly! If you use a plain python list, the parameters won’t be registered properly and you can’t pass them to your optimizer using  model.parameters() .