I think the ReduleLROnPlateau would only reduce the learning rate, so it would be stuck at this value.
However, you could adapt this scheduler to increase the learning rate again using a similar approach.