Yes exactly.
If you tokenize with another tokenizer at some point it won’t use the cache indeed and will create a new cache file (the inputs function given to map is pickled recursively to extract all the dependencies).
Also, you don’t need to do remove_columns_, setting the format with the list of columns is enough (see https://huggingface.co/docs/datasets/torch_tensorflow.html 3)