Hi guys! I was using a scheduler to decrease the learning rate of my optimizer gradually and the one I was using was CosineAnnealingWarmRestarts().It has a maximum learning rate which is set by us and anneals the learning rate in a cosine curve manner until it hits a restart where the learning rate is set to maximum again and the cycle restarts. What I wanted to do is decrease the learning rate the optimizer is initialized with every restart. Is that possible in Pytorch?