NLP, Data Science, Artificial Intelligence, Machine Learning, Language Model.
probabilities given by our language model to a generic second word that follows “a”: Probabilities assigned by a language model to a generic second word w2 in a sentence. Image by the author. The probability of “red” as the second word in the sentence after “a” is: P(“red” | “a”) = 0.27 Similarly,