Bert, NLP.
Tokenization and Word Embedding Next let’s take a look at how we convert the words into numerical representations. We first take the sentence and tokenize it. text = "Here is the sentence I want embeddings for." marked_text = "[CLS] " + text + " [SEP]" # Tokenize our sentence with the BERT