Hi,
I am trying to use the Cyclic on my model. I changed the optimizer from Adam to SGD due to (if I understood well) a bug in the last stable version of pytorch.
The problem now is that no matter what base_lr and max_lr I take to initiate the scheduler, the learning rate fluctuates between 1e-4 and 1e-2.