Hi @Buckeyes2019,
Not a direct answer to your question, but you can use the scripts in examples/seq2seq here 238 (finetune.py or finetune_trainer.py)  for fine-tuning BART and other s2s models. It supports custom datasets as well. All you’ll need to do is get the data in the required format mentioned in the redme.