There are a lot of good articles and posts in the forums about custom tokenizers that allow you to train a different vocabulary/language. I cannot find information, though, on customizing the position part as well. Is there documentation on this? If not, can someone point me in the right direction. My goal is to train a transformer on a dataset where the 2-D position of the glyph in the document is just as important as the glyph itself.
Thanks!
Note: A similar 1 question asked before by @bengul but there has been no response since July 2021.