But it still follows something like:
lr = 0.001     if epoch < 7
lr = 0.0001    if 7 <= epoch < 14
lr = 0.00001   if 14 <= epoch < 21
And for epoch = 7, if we call scheduler.step(), lr will be updated from 0.001 to 0.0001
for epoch = 8, if we call scheduler.step(), lr will be still 0.0001, right?