Is your script run_multi using Trainer? By default the Trainer removes any column that is not in your model signature (like “source_ids”), so you should pass --remove_unused_columns False in your command.