Note that this is validation accuracy, not test accucary. Now that I am thinking about it, I am wondering whether the drop in accuracy I am seeing is a side effect of the augmentation. I will report a value on the test set tomorrow!