Hello,
I have a few questions about the BertModelLMHeadModel:


Is BertModelLMHeadModel  used to conduct the regular language modeling (next token prediction), as it is the case for the GPT2LMHeadModel?


For GPT2LMHeadModel, I can just specify labels = input_ids for convenience. I just specify the labels in this way for the BertModelLMHeadModel as well?


Thanks,