You should take the same approach as Extractive text summarization :
Concatenate all your sentences, separated with a special token (CLS for example), then use the CLS token representation to do classification.
From the Presumm paper 57
image1533×484 100 KB