Make `add_special_tokens` more clear
# What does this PR do?

Fix tokenization. The short term goal is to fix #20418 (well, make things more clear)

The long term goal is to be able to have a generic fix for #20401, but the tokenizer thing is somehow complicated, and I can only fix step by step.



_The documentation is not available anymore as the PR was closed or merged._