for supervised and unsupervised machine translation. MBart is one of the first methods for pretraining a complete
sequence-to-sequence model by denoising full texts in multiple languages,
The library provides a version of this model for conditional generation.
The mbart-large-en-ro checkpoint can be used for english ->
romanian translation.
The mbart-large-cc25 checkpoint can be finetuned for other
translation and summarization tasks, using code in examples/pytorch/translation/ , but is not very useful without
finetuning.
ProphetNet
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training, by
Yu Yan, Weizhen Qi, Yeyun Gong, Dayiheng Liu, Nan Duan, Jiusheng Chen, Ruofei Zhang, Ming Zhou.
ProphetNet introduces a novel sequence-to-sequence pretraining objective, called future n-gram prediction. In
