As mentioned in the notebooks, the task is causal language modeling at first, so predict the next word. They also explicitly say that:

First note that we duplicate the inputs for our labels. This is because the model of the  Transformers library apply the shifting to the right, so we don’t need to do it manually.

Which is why you see the same labels as the inputs.