For future reference if anyone comes across this thread:
There is this model facebook/mbart-large-cc25 · Hugging Face 7
It seems like mBart can also be fine tuned for summarization (The docs even provide a sample for that). The nice thing is that it accepts a maximum input length of 1024 so I’ll be giving that a shot, before I do anything else