I am using reduce LR on Plateau scheduler to reduce the learning rate, i need to reset the learning rate, once it reaches 10^-6.
Does adding below line helps???
optimizer.param_groups[0]['lr'] = 0.0001