PyTorch uses the channels-first layout by default and you could switch to channels-last, in case you are using mixed-precision training and your GPU supports TensorCores to speed up these operations. Note that the user-facing shapes would still be shown in the default channels-first layout as described in the tutorial.