NLP, Data Science, Artificial Intelligence, Machine Learning, Language Model.
probabilities, without the influence of the sentence length. This can be done by normalizing the sentence probability by the number of words in the sentence. Since the probability of a sentence is obtained by multiplying many factors, we can average them using the geometric mean. Let’s call