Language model training with NSP using run_language_modeling.py
When using "run_language_modeling.py" for fine-tuning BERT is only the MLM task used or also the NSP task as described in the paper?
This is currently not supported. There used to be some community maintained examples IIRC. You can have a look here: https://github.com/huggingface/transformers/tree/1.1.0/examples/lm_finetuning

