Hi,
You can provide the argument pad_to_multiple_of to a tokenizer in Transformers (this is supported both for fast and slow tokenizers):
pad_to_multiple_of: (optional) Integer if set will pad the sequence to a multiple of the provided value. This is especially useful to enable the use of Tensor Core on NVIDIA hardware with compute capability
>= 7.5 (Volta).