Solved by alex.veuthey in post #5 
              
              
                If the question is about the step method of the learning rate scheduler (in this case StepLR), then you should also call the schedulers’ step method, which is different from that of the optimizers. 
Since you say that they have joint training, it might be preferable to use one optimizer with the par…