NLP, Data Science, Artificial Intelligence, Machine Learning, Language Model.
probabilities of sentences with different lengths. The higher this number is over a well-written sentence, the better is the language model. So, what does this have to do with perplexity? Well, perplexity is just the reciprocal of this number. Let’s call PP(W) the perplexity computed over the