Yes. I can see this unexpected behavior of printing out even then not really adjusting learning rate. First, you can decrease the amount of printing by doing steps only after every epoch, as this type of scheduler working on per epoch basis.