Typical things to try:

Change model arch (width / depth), why does your model not overfit the data?
Look at your results, find out something about the failure and see if there are systematic things your model gets wrong.
One black box thing that might help is learning rate schedules (eg decrease lr by multiplying with 1/3 after, say, 40 epochs).

Best regards
Thomas