Don’t think decoder_start_token_id is the issue, it will be set from config. Your command also looks reasonable.
Debugging ideas:

Try 1 GPU
looked at the saved text_batch.json to make sure it makes sense.
make sure command is same as it was for BART
remove n_train=-1