May you release the conversion script/command as well?
#1
by
andreaw-ag
- opened
I am trying to do this myself, but I am getting;:
Exception: Vocab size mismatch (model has 32000, but tokenizer.model has 32001).
@andreaw-ag try using --pad-vocab