Solved by ptrblck in post #2 
              
              
                You could see the changing behavior by iterating the scheduler for 720 steps, since you’ve specified steps_per_epoch=72 and epochs=10. 
From the docs: 

epochs (int): The number of epochs to train for. This is used along with steps_per_epoch in order to infer the total number of steps in the cycle i…