Hi @valhalla
Thank you for the detailed answer.
I now understand that you are in the process of re-writing the seq2seq fine-tuning scripts and adapting Seq2SeqDataCollator to the latest version is in a waiting state.
I think I’ll use the conventional script for now, but I’d love to check out the PR.