Additionally to what @Sandipan_Majhi said: in case you would like to wrap these models in a list, which would properly register these models, use e.g. nn.ModuleList instead of a Python list (same for nn.ModuleDict vs. dict).