I am finetuning a QA model in Hindi using a trained Roberta LM. I need to preprocess the dataset for Roberta. What are the steps that I need to take before I feed the input to the model? One script for English is given here 9. I am not sure if other languages behave in a similar way. e.g The linked notebook adds an extra " " character before the start token. Is this necessary for Roberta? What are other nuances that have to be taken care of?
I am only concerned about spans at token-level and not character-level as explained in the link mentioned above.
Thank you.