Can GPT2DoubleHeadsModel be used for regular next token prediction task without adjusting its head?
Hello,

According to the HuggingFace Transformer's website (https://huggingface.co/transformers/model_doc/gpt2.html#gpt2doubleheadsmodel), **GPT2DoubleHeadsModel** is the GPT2 Model transformer with a language modelling and a multiple-choice classification head on top e.g. for RocStories/SWAG tasks. 

Does this mean that we can use the **GPT2DoubleHeadsModel** for the regular language modelling task (i.e. next word prediction) without modifying its head? or would I need to adjust the head of **GPT2DoubleHeadsModel** if I want to do the next word prediction, since GPT2DoubleHeadsModel is for answering multiple-choice type questions only?

Thank you,

You don't need to do anything in order to make it predict the next word. That's what it is. But you may consider finetuning it with your own dataset.<|||||>Hello,

Thank you for your reply.
so the **GPT2DoubleHeadsModel** (NOT GPT2LMHeadModel but the DoubleHeadsModel), without any adjustment on its head, can be used for any "non-multiple-choice-based" next token prediction, as well as for the multiple-choice questions?

Thank you,<|||||>Edit:
I'm not sure. I did missread the GPT2DoubleHeadsModel.<|||||>If GPT2DoubleHeadsModel can process both multiple-choice questions as well as non-multiple-choice next token predictions without any adjustment, why did HuggingFace make 2 different GPT2 models -- GPT2DoubleHeadsModel and GPT2LMHeadModel ?

Can GPT2DoubleHeadsModel process both multiple-choice questions as well as non-multiple-choice next token predictions without any further adjustment(s) [e.g. adjustment on its head, etc,]?<|||||>So?