How to use DistilBertTokenizer in C++
I saw that fast tokenizers was realized as Rust library, but I not fund bindings for C++, and also I cannot use a pretrained distilled tokenizer in fast mode.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
