sgugger gave a fine technical definition, but I believe that the intuition is that it estimates the “pool of words” the model has to choose between. Perplexity of 6 means that it’s essentially rolling a die and choosing between one of 6 options when it tries to guess what a word might be. Check out 4.2 “Weighted Branching Factor” here 21.