No, this was just a BERT thing that it had in its original code and is a part of its pretraining objective. There is no reason to add it to other models that did not use that in their pretraining objective.