- msmarco-roberta-base-ance-firstp is the MSMARCO Dev Passage Retrieval ANCE(FirstP) 600K model from ANCE. This model should be used with dot-product instead of cosine similarity.
- msmarco-distilbert-base-tas-b uses the model from sebastian-hofstaetter/distilbert-dot-tas_b-b256-msmarco. See the linked documentation / paper for more details.
- Encoding speeds are per second and were measured on a V100 GPU and an 8 core Intel(R) Xeon(R) Platinum 8168 CPU @ 2.70GHz
Changes in v3
The models from v2 have been used for find for all training queries similar passages. An MS MARCO Cross-Encoder based on the electra-base-model has been then used to classify if these retrieved passages answer the question.
If they received a low score by the cross-encoder, we saved them as hard negatives: They got a high score from the bi-encoder, but a low-score from the (better) cross-encoder.
