It just make the computations less efficient.
For example, RNN usually take temporal dimensions 1st because blocks are contiguous from left to right.
If you slice through other dimensions, you are taking parts of different memory blocks.