Solved by LeviViana in post #2 
              
              
                You could write your own lr_scheduler by basically copying and pasting the source code of StepLR. You could integrate a variable verbose that when set True, it warns you when the LR is being changed. It is actually already implemented in the ReduceLROnPlateau.