Hi @VP1 and @lewtun ,
thank you very much for your kind reply. Yes, as you mention @VP1, I am trying to fine-tune BERT (as language modeling) with domain-specific vocab/text. Thank you very much I will try it.