Bert, NLP.
The original word has been split into smaller subwords and characters. This is because Bert Vocabulary is fixed with a size of ~30K tokens. Words that are not part of vocabulary are represented as subwords and characters. Tokenizer takes the input sentence and will decide to keep every word as a