Solved by ptrblck in post #2 
              
              
                max_lr from the scheduler should limit the learning rate from the optimizer. 
You could print out the learning rate for all optimizer.param_groups to check this effect.