valhalla:

You can use Trainer for seq2seq tasks as it is. Patrick’s PR extends it so that generative metrics can be calculated (ROUGE, BLUE etc), it should be okay if you calculate them after training the training is finished.


Oops sorry, I meant that Trainer does not work out of the box for seq2seq