Yes! Contiguity of data matters a lot for performance reasons.
In particular, many operations are written in a way such that they only work if the inputs are contiguous. In this case, the operation will copy its inputs to be contiguous and then send the inputs through the operation.  Copying tensors to make them contiguous (tensor.contiguous()) gets very time-consuming for large tensors.