Good luck @rasel277144 ! One last thing I forgot to mention: if you decide to adopt the embedding-based approach, you will probably get better results if you use sentence-transformers 1 which use a siamese network to obtain “better” embeddings that what you’ll typically get with vanilla BERT and just extracting the last hidden states. You can find a performance comparison here across various tasks / datasets, and many of the models are available on the Hub