I’ve been recently working on text punctuation restoration which is a problem where you have some text with missing punctuation and you want to add it back.
Reading some papers, it seems one of the best approaches is to use Transformers as if you were doing a translation, from a language which there’s no punctuation to one that has it.
I am trying to use  Hugging Face transformers, but I’ve been struggling to find good resources to learn how to train a translation network from scratch. Most of the documentation is related to other tasks and when it comes to translation, I’ve found only docs that explain how to use pre-trained models.
Could someone help me giving a direction?
I’m still trying to test a naïve approach where I want to give my model some text without punctuation and I want it to predict a new sentence where for each input token, it predicts if it’s preceded by some punctuation or not.
Sorry if there’s somewhere really obvious in the documentation I didn’t look at.
Thanks for reading this and I wish you a wonderful day!