I always assumed the data augmentation should fill the “real data domain” with randomly transformed samples, i.e. the transformations should stick close to what you would expect to see in the wild (but I might not be up-to-date on this topic).