marcomatta:

It has no labels but the DataCollatorForTokenClassification should help me out generating them.


No, you need to preprocess your dataset to generate them. The data collator is only there to pad those labels as well as the inputs. Have a look at one of the token classification example script 1 or example notebook 1