Yes! refer to examples/seq2seq https://github.com/huggingface/transformers/tree/master/examples/seq2seq 64
It supports fine-tuning seq2seq models in the library. The readme has all the details.
Supports both pytorch-lightning and native Trainer