How to use the pretrain script with only token classification task ?
Hi, I need to train on my own twitter corpus, but most of the twitter contains only one sentence. Therefore I can not use the sentence prediction task to train the model. Will the script automatically use only token classification task when there is no next sentence ? Thanks in advance.
No, you probably need to adapt the example script to your exact task.