It is almost impossible to suggest anything without additional information.

How many classes are you trying to predict?
How many training images do you have?
Does your dataset suffer from data imbalance?
Have you already checked your data? (e.g. if it is labeled correctly)