 Blank line indicates the end of a document for NER training ?
Hi everyone!

In the <https://huggingface.co/transformers/custom_datasets.html#token-classification-with-w-nut-emerging-entities> , it says that each line of the  dataset file contains either (1) a word and tag separated by a tab, or (2) a blank line indicating the end of a document. 

The blank line should not represent the end of a sentence?




This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
<|||||>This issue has been automatically marked as stale and been closed because it has not had recent activity. Thank you for your contributions.

If you think this still needs to be addressed please comment on this thread.