It is likely that the multiprocessing step does not work well with GPU-accelerated tasks as that means duplicating the whole main process - and you’ll run out of memory. (Not sure why it runs into an initialization error though). Does it work without num_proc?
It’s possible that you should use tokenizer.batch_encode_plus here because you are passing a batch.