Is it possible to have high perplexity of some individual sentences, as compared to overall testing corpus perplexity?
Hi,

I have calculated an overall perplexity of my testing corpus after finetuning GPT-2 pretrained model
Similarly, I have also calculated perplexity of individual sentences, after extracting it from my testing corpus.

**I notice that some individual sentence perplexity is even higher than the overall perplexity.** 

What will be the reason for it? Will it be possible? Have I done something wrong in my calculation? 


Kindly share your opinion.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
