cross-encoder/quora-distilroberta-base - Average Precision dev set: 87.48
cross-encoder/quora-roberta-base - Average Precision dev set: 87.80
cross-encoder/quora-roberta-large - Average Precision dev set: 87.91
Note: The model don't work for question similarity. The question How to learn Java and How to learn Python will get a low score, as these questions are not duplicates. For question similarity, the respective bi-encoder trained on the Quora dataset yields much more meaningful results.
NLI
Given two sentences, are these contradicting each other, entailing one the other or are these netural? The following models were trained on the SNLI and MultiNLI datasets.
- cross-encoder/nli-deberta-v3-base - Accuracy on MNLI mismatched set: 90.04
- cross-encoder/nli-deberta-base - Accuracy on MNLI mismatched set: 88.08
