In my Roberta2Roberta  experiment for inference on cnn test dataset on P100, it took 2 hours , 22 minutes.
I fine-tuned for 16 hours but got much worse results than Patrick. ROUGE-2 F-measure was just 9.9