How to fine-tune a model with my custom tokenizer?
1. I want to train a tokenizer with my own datasets.
2. I have no enough data and resources to train a pretrained model from scratch.

pipeline:
1. train a tokenizer like [tokenizer_training](https://github.com/huggingface/notebooks/blob/master/examples/tokenizer_training.ipynb)
2. do something with current pretrained model, get a new pretrained model
3. fine-tune the pretrained model with my domain datasets, get my domain pretrained model
4. fine-tune the domain pretrained model for my downstream task.

and what should I do in the 2rd step?
Hello, thanks for opening an issue! We try to keep the github issues for bugs/feature requests.
Could you ask your question on the [forum](https://discuss.huggingface.co) instead?

Thanks!<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.