readme: # Less is More: Pre-train a Strong Text Encoder for Dense Retrieval Using a Weak Decoder
  
  Please check the [official repository](https://github.com/microsoft/SEED-Encoder) for more details and updates.
  
  
  # Fine-tuning on Marco passage/doc ranking tasks and NQ tasks
  
  |   MSMARCO Dev Passage Retrieval    | MRR@10  | Recall@1k |
  |------------------------------|---------------|--------------------- |
  | BM25 warmup checkpoint     |     0.329     |      0.953     |
  | ANCE Passage  checkpoint  |     0.334   |   0.961       |
  
  |   MSMARCO Document Retrieval    | MRR@10 (Dev)  |  MRR@10 (Eval) |
  |---------------- | -------------- | -------------- |
  |  ANCE Document (FirstP)  checkpoint   |     0.394       |    0.362     | 
  
  
  | NQ Task      | Top-1  |  Top-5    | Top-20  |  Top-100 |  MRR@20    | P@20  |
  |---------------- | -------------- | -------------- |-------------- | -------------- | -------------- |-------------- |
  | DPR checkpoint    |     46.1       |        68.8     |    80.4     |   87.1      |   56.2    |    20.1   |
  | ANCE NQ checkpoint    |   52.5        |       73.1      |      83.1   |   88.7   |       61.5   |    22.5 
  
  
  # Citation
  
  If you find SEED-Encoder useful for your work, please cite the following paper:
  
   ```
    @article{lu2021less,
      title={Less is More: Pre-training a Strong Siamese Encoder Using a Weak Decoder},
      author={Lu, Shuqi and Xiong, Chenyan and He, Di and Ke, Guolin and Malik, Waleed and Dou, Zhicheng and Bennett, Paul and Liu, Tieyan and Overwijk, Arnold},
      journal={arXiv preprint arXiv:2102.09206},
      year={2021}
    }
   ```
  
  
  