Simple train from the start for translation transformer
Hi, sorry to bother. I am trying to train a translation transformer, I have seen the documentation but I am still really lost.

I have two datasets, the original message and the translated message.

Example:
dataset_x.txt
This is the message.
This is another message.
Another one.

dataset_y.txt
This<&>is the message<^>.
This is another<&> message.
Another one<%>.

I wanted a simple script which could tokenize these datasets and train any suited model from scratch.
Could anyone help me? Thanks a bunch!

I found the repo simpletransformers, which uses this marvelous repo of yours. I got to run a transformer through there, so I'll be closing the issue now. Thanks anyway!