Hello @FL33TW00D, I am using paraphrase-distilroberta-base-v1 to find important paragraphs in a book, starting from a summary. My books are not very technical though, that’s why I did not explore any topic-related model.
I compare this sentence-transformers 26 method with word2vec, doc2vec and a personalized method that uses rouge. Sentence-transformers is the most accurate from my experiments.
I believe using bio/sciBERT with mean pooling would bring similar results. However, the model I am using is already fine-tuned for sentence comparison.