Is there any need to fine-tune the already pre-trained GPT-2 models?
Hello,

If I am using the pre-trained GPT-2 for my research, should I still fine-tune the already pre-trained models with my dataset? I am a bit confused by the term "pre-trained".

Thank you,
"Finetuning" a GPT-2 model is generally used for generation, to make it output text more similar to a given dataset.

If you are using it for other tasks (e.g. binary predictions), you may not have to finetune it.<|||||>Hello,

Thank you for your reply.
So say if I am trying to solve multiple choice questions with GPT2DoubleHeadsModel, should I just use the pre-trained model without fine-tuning?

Thanks, <|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
