mlearner:

even increasing the learning rate


I would recommend the opposite and try to decrease the learning rate.
Also, try to overfit a small data sample and make sure your model is able to do so.