When I think about it I think changing architecture to a Convolutional Neural Network (CNN) might also help it generalize better. The dataset is also images, where CNN’s perform much better. Perhaps this might be easier to try first before diving deeper into data augmentation.