Hi @Erpa


Yes, BartForConditionalGeneration is the LM model.


Currently seq2seq pre-training examples are not available in transformers. FairSeq has the implementation of Bart denoising dataset, so that might help, You can find it here 33