We’re working on some speed ups to better support the tokenizers from transformers or from the tokenizers library.
Last improvement (here 9) implied a x10 speed up on using a tokenizer by removing unnecessary conversions when reading/writing from Arrow format, and will be available in the next release, along with multiprocessing 
Our goal is to be as close as possible to the optimal conditions for tokenization.