NLP, Data Science, Artificial Intelligence, Machine Learning, Language Model.
sentence W. Then: PP(W) = 1 / Pnorm(W) = 1 / (P(W) ^ (1 / n)) = (1 / P(W)) ^ (1 / n) Which is the formula of perplexity. Since perplexity is just the reciprocal of the normalized probability, the lower the perplexity over a well-written sentence the better is the language model. Let’s try computing