Since this generation framework python -m torch.distributed.launch --nproc_per_node=2  run_distributed_eval.py works for other models, including BART, PEGASUS, I am not sure why it fails with ProphetNet here.