Character-level tokenization?
# ❓ Questions & Help

In a project I'm using the Hugging Face library for, I would like to use transformers to perform arithmetic (framed as a text-to-text problem). However, it seems that the current method of tokenization adopted by most existing models in the Hugging Face library (BPE, WordPiece, etc.) are not character-level, and thereby, would not allow for the network to properly process the input for later arithmetic. Are there any ways to get this sort of analysis to work properly with the existing models in Hugging Face (and their accompanying tokenizers), otherwise, what recommendations do you have?

For reference, I am currently using the BART model from Hugging Face.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
