I see why it fails: you should only keep those columns that the model needs in your dataset (input_ids, attention_mask, token_type_ids, labels).
Also, I would check if the labels are created correctly, because the error seems to indicate that the issue happens when computing the loss between the logits and the labels.