Bert, NLP.
Understanding BERT — Word Embeddings BERT Input BERT can take as input either one or two sentences, and uses the special token [SEP] to differentiate them. The [CLS] token always appears at the start of the text, and is specific to classification tasks. Both tokens are always required, even if we