Is the separation token absolutely necessary if I use GPT2DoubleHeadsModel with token_type_ids?
Hello,

I am trying to use the GPT2DoubleHeadsModel to process the multiple choice questions.
For the pre-processing of the multiple choice questions, I didn't add any special separating token between the multiple choice question and the multiple choice option. Instead, I generated the token_type_ids, which denote 0 for the question portion of the text, and 1 for the multiple choice option. Then I tried to make the GPT2DoubleHeadsModel to predict the correct answer by doing:

```python
gpt2DoubleHeadsModel(input_ids=input_ids, token_type_ids = token_type_ids)
```

Is this practice acceptable? or do I absolutely need to insert a special separation token between the question text and the multiple choice option text?

Thank you,  

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
