Solved by JuanFMontesinos in post #4 
              
              
                Hi, it’s not really necessary. You can create a new nn.Module which contains both and use a single optimizer our you can feed both models into a single one