Hello everyone,
I’m trying to find the existing evaluation results for training GPT-2 on WikiText-2. In GPT-2 model card 9, it is mentioned that the perplexity is 29.41, whereas in this 1 blog post by OpenAI, it is said that the perplexity is 18.34 for this task.
I was wondering whether this difference is due to different loss (huggingface used the casual language modeling loss) ?