How large are your current training, validation, and test datasets?
Generally more samples help in this scenario. Additionally you could increase the regularization (such as adding or increasing dropout or adding weight decay), adding more data augmentation etc.
It can also be useful to check the training and validation datasets manually and make sure the samples come from the same domain and are thus “similar”.