Hi @cezary, in addition to the suggestions from @marcoabrate a crude approach would be to take the average of the sentence-level embeddings from sentence BERT. This would give you a document-level representation which although crude should serve as a strong baseline for your task