I don’t think you should see a significant difference as long as the data augmentation and transformations are applied to the corresponding dimensions, since the activation volume would just be permuted, i.e. the same would happen if you transpose the height and width of an image.