Should it be done using class BertForMultipleChoice(BertPreTrainedModel)?
Found also transformers-tutorials/transformers_multi_label_classification.ipynb at master · abhimishra91/transformers-tutorials · GitHub 18 , but authors didn’t use BertForMultipleChoice there.