I agree with your logic on that. I can as well understand the logic of pythorch team decision. I can think of it as of some consistent debugging interface then if you set verbose=True, you will see the learning rate at each scheduler step for every scheduler you decided to choose.