denocris:


latest pip version 20.3.3 (On Colab I had installed by default 19 and something);



I resolved it.

Uninstalled transformers
Installed transformers sentencepiece like this : !pip install --no-cache-dir transformers sentencepiece

Use_fast= False like this:  tokenizer = AutoTokenizer.from_pretrained(“XXXXX”, use_fast=False)