Solved by tom in post #2 
              
              
                While structuring it (with separate nn.Module classes for base and classifier) would look more natural to me in your example, you can pass any list/iterator to the optimizers for the parameters, not just ParameterLists / Sequential. 
For example: 
some_params = []
some_params.extend(fc1.parameters()…