Regarding “E.g. if it’s the channel dimension, I would expect that conv kernels “learn” the order.”
Ah, I see. To be specific, I am pretty much using a traditional UNet. Does that mean we expect that UNet Conv kernels would “learn” the order?