Does OA mean overall accuracy?
If so, do you have an imbalanced dataset and how are the class frequencies?
You could also try just the inverse of the class frequencies and see, how well your model performs.
For the learning rate schedule, you could try ReduceLROnPlateau 34.