Hi @marcoabrate ,
Thanks for the info! For my task (clustering wikipedia entries for a certain class of medications), I found the standard BERT vocab quite lacking so tried SciBERT with mean pooling and results didn’t quite stand up to TFIDF. This is understandable though since it’s mean pooling to get the sentence vectors and then I mean pool to get paragraph vectors.
Glad you manged to get it to work though! I’ll keep it in mind for future projects.
Thanks,
Chris