This assumes that len(input_ids) == len(decoder_input_ids), which is not true for summarization
since bart-large-cnn has smaller embeddings, it is less likely to OOM (have an N/A entry)
env: v100 16GB GPU, fp16
Train times show bart more than 2x faster

model,batch_size,sequence_length,result
facebook/mbart-large-en-ro,4,8,0.0669
facebook/mbart-large-en-ro,4,32,0.0699
facebook/mbart-large-en-ro,4,128,0.1377
facebook/mbart-large-en-ro,4,512,0.3529
facebook/mbart-large-en-ro,8,8,0.0672
facebook/mbart-large-en-ro,8,32,0.0831
facebook/mbart-large-en-ro,8,128,0.1928
facebook/mbart-large-en-ro,8,512,N/A
facebook/mbart-large-en-ro,12,8,0.0687
facebook/mbart-large-en-ro,12,32,0.1156
facebook/mbart-large-en-ro,12,128,0.2629
facebook/mbart-large-en-ro,12,512,N/A
facebook/mbart-large-en-ro,16,8,0.0705
facebook/mbart-large-en-ro,16,32,0.1392
facebook/mbart-large-en-ro,16,128,0.3334
facebook/mbart-large-en-ro,16,512,N/A

model,batch_size,sequence_length,result
facebook/bart-large-cnn,4,8,0.0619
facebook/bart-large-cnn,4,32,0.0629
facebook/bart-large-cnn,4,128,0.0623
facebook/bart-large-cnn,4,512,0.1274
facebook/bart-large-cnn,8,8,0.0699
facebook/bart-large-cnn,8,32,0.0628
facebook/bart-large-cnn,8,128,0.0705
facebook/bart-large-cnn,8,512,0.2347
facebook/bart-large-cnn,12,8,0.0614
facebook/bart-large-cnn,12,32,0.0620
facebook/bart-large-cnn,12,128,0.0884
facebook/bart-large-cnn,12,512,N/A
facebook/bart-large-cnn,16,8,0.0667
facebook/bart-large-cnn,16,32,0.0668
facebook/bart-large-cnn,16,128,0.1075
facebook/bart-large-cnn,16,512,N/A