pretrain for chinese dataset
Hi , I want to pretrain my model for chinese dataset . can i use my own vocab.txt ? 
and what is the format for vocab.txt ? thanks a lot
Hi, you should probably turn to the TensorFlow version for pre-training.
This package is mostly intended to be used for fine-tuning pre-trained models.
Another option for BERT-like pre-training is to use Facebook's [XLM](https://github.com/facebookresearch/XLM)