Fix to removing ESM special tokens
This is a followup to PR #22770 - I forgot that because of the way the ESM tokenizer is structured that the EOS token would come back after it was saved and reloaded. By making the special tokens arguments to the tokenizer, we can set them using `init_kwargs` and ensure that they stay changed permanently. Sorry for overlooking this in the last PR!
that took like 45 seconds how do you see your notifications that quickly<|||||>Ah ah, I was on my GitHub already that's all.<|||||>I'm intimidated nonetheless!<|||||>_The documentation is not available anymore as the PR was closed or merged._