Hi, I am more a CV guy and recently get interested in doing a nlp project.
In this project, one part might involve extracting sentence-level semantic representation from a pretrained model.
In computer vision, one standard way to extract feature of an image or a video snippet could be
using Resnet pretrained on Imagenet or I3D pretrained on Kinetics datasets, respectively.
I want to do the similar thing but in nlp domain. I wonder if there are some recommended models pretrained on specific dataset for me to try?
As far as my limited understanding, models trained on datasets which aim to to tell if two sentences are semantically equal could be a direction (e.g. QQP, STS-B ). But it needs a pair of sentences, my case is just feeding one sentence (or one block of sentences), not in a pair format. Any suggestion? Thanks!