- masked_lm_labels becomes labels in DistilBertForMaskedLM.
- masked_lm_labels becomes labels in ElectraForMaskedLM.
- masked_lm_labels becomes labels in LongformerForMaskedLM.
- masked_lm_labels becomes labels in MobileBertForMaskedLM.
- masked_lm_labels becomes labels in RobertaForMaskedLM.
- lm_labels becomes labels in BartForConditionalGeneration.
- lm_labels becomes labels in GPT2DoubleHeadsModel.
- lm_labels becomes labels in OpenAIGPTDoubleHeadsModel.
- lm_labels becomes labels in T5ForConditionalGeneration.
In several models, the caching mechanism becomes consistent with the other models:
- decoder_cached_states becomes past_key_values in all BART-like, FSMT and T5 models.
- decoder_past_key_values becomes past_key_values in all BART-like, FSMT and T5 models.
- past becomes past_key_values in all CTRL models.
