Is is possible to fine-tune GPT2 on downstream tasks currently?
Is is possible to fine-tune GPT2 on downstream tasks currently?
Yes we could add this. You mean tasks like GLUE or SQuAD?<|||||>> Yes we could add this. You mean tasks like GLUE or SQuAD?

Yes! exactly!
Please add this, thanks!<|||||>@thomwolf Are you still working on the code to finetune the GPT2 language model (not classification task)? Thanks.<|||||>@experiencor @thomwolf also curious about GPT2 LM finetuning issue, thanks!<|||||>We'll add an example for fine-tuning the models (probably refactor the Bert's one at the same time) this month.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
<|||||>> We'll add an example for fine-tuning the models (probably refactor the Bert's one at the same time) this month.

Did you add the example ? looking for an example of fine tuning gpt-2 for downstream tasks.<|||||>+1. Also interested.