So for the method load_tf_weights_in_bert，the ckpt is still read using pytorch.
Does it mean I can’t load ckpt file in a enviement that just have tensorflow?
That’s really complex.
The framework like keras-bert、keras4bert both can load ckpt. Can transformers add this method in a new version?
Because for those of us who are not native English speakers，we need use some like bert-chinese-tiny , CHINESE ALBERT(pretrain by Chinese team) and even the models from google-search’s github. They can download from Internet easily.

图片781×315 19.3 KB

But it same like load them into model is a really difficult thing when use the transformers