transformers safetensors nvretriever feature-extraction mteb custom_code en arxiv:2407.15831 arxiv:2401.00368 license:other model-index region:us
---
language:
- en
license: other
tags:
- mteb
model-index:
- name: NV-Retriever-v1
  results:
  - task:
      type: Retrieval
    dataset:
      name: MTEB ArguAna
      type: mteb/arguana
      config: default
      split: test
      revision: c22ab2a51041ffd869aaddef7af8d8215647e41a
    metrics:
    - type: main_score
      value: 68.277
    - type: map_at_1
      value: 44.666
    - type: map_at_10
      value: 60.3
    - type: map_at_100
      value: 60.692
    - type: map_at_1000
      value: 60.693
    - type: map_at_20
      value: 60.645
    - type: map_at_3
      value: 56.472
    - type: map_at_5
      value: 58.78
    - type: mrr_at_1
      value: 45.092460881934564
    - type: mrr_at_10
      value: 60.493378717063074
    - type: mrr_at_100
      value: 60.87988588545791
    - type: mrr_at_1000
      value: 60.88044591502747
    - type: mrr_at_20
      value: 60.83224958805471
    - type: mrr_at_3
      value: 56.53153153153162
    - type: mrr_at_5
      value: 58.942626837363854
    - type: nauc_map_at_1000_diff1
      value: 14.137909741937149
    - type: nauc_map_at_1000_max
      value: -13.946656236190021
    - type: nauc_map_at_1000_std
      value: -27.431659737602732
    - type: nauc_map_at_100_diff1
      value: 14.136483238553824
    - type: nauc_map_at_100_max
      value: -13.946721068575075
    - type: nauc_map_at_100_std
      value: -27.43462339510713
    - type: nauc_map_at_10_diff1
      value: 13.961240252441984
    - type: nauc_map_at_10_max
      value: -13.804526866049605
    - type: nauc_map_at_10_std
      value: -27.35573153559941
    - type: nauc_map_at_1_diff1
      value: 16.257792463128126
    - type: nauc_map_at_1_max
      value: -16.164790771610072
    - type: nauc_map_at_1_std
      value: -27.84021734986689
    - type: nauc_map_at_20_diff1
      value: 14.106499894575682
    - type: nauc_map_at_20_max
      value: -13.930699708027205
    - type: nauc_map_at_20_std
      value: -27.47446428876476
    - type: nauc_map_at_3_diff1
      value: 15.018611065750246
    - type: nauc_map_at_3_max
      value: -12.659774043658842
    - type: nauc_map_at_3_std
      value: -27.186079034885598
    - type: nauc_map_at_5_diff1
      value: 14.199306816408377
    - type: nauc_map_at_5_max
      value: -13.261282961741303
    - type: nauc_map_at_5_std
      value: -26.71739573072423
    - type: nauc_mrr_at_1000_diff1
      value: 12.629073492081275
    - type: nauc_mrr_at_1000_max
      value: -14.666344334069448
    - type: nauc_mrr_at_1000_std
      value: -27.30760238816266
    - type: nauc_mrr_at_100_diff1
      value: 12.627677268171094
    - type: nauc_mrr_at_100_max
      value: -14.66639461039424
    - type: nauc_mrr_at_100_std
      value: -27.310569102264846
    - type: nauc_mrr_at_10_diff1
      value: 12.482407364331927
    - type: nauc_mrr_at_10_max
      value: -14.509649052862667
    - type: nauc_mrr_at_10_std
      value: -27.246235066954423
    - type: nauc_mrr_at_1_diff1
      value: 15.084265144497373
    - type: nauc_mrr_at_1_max
      value: -16.312295398834625
    - type: nauc_mrr_at_1_std
      value: -27.686736137340894
    - type: nauc_mrr_at_20_diff1
      value: 12.600281810712003
    - type: nauc_mrr_at_20_max
      value: -14.649133303237166
    - type: nauc_mrr_at_20_std
      value: -27.350630544847004
    - type: nauc_mrr_at_3_diff1
      value: 13.081208137779557
    - type: nauc_mrr_at_3_max
      value: -13.91769455651833
    - type: nauc_mrr_at_3_std
      value: -27.42237181201488
    - type: nauc_mrr_at_5_diff1
      value: 12.697412153053486
    - type: nauc_mrr_at_5_max
      value: -14.046815225580204
    - type: nauc_mrr_at_5_std
      value: -26.69417403787157
    - type: nauc_ndcg_at_1000_diff1
      value: 13.984706619459738
    - type: nauc_ndcg_at_1000_max
      value: -13.48207980711916
    - type: nauc_ndcg_at_1000_std
      value: -27.16935912553381
    - type: nauc_ndcg_at_100_diff1
      value: 13.951491624929446
    - type: nauc_ndcg_at_100_max
      value: -13.483812067015261
    - type: nauc_ndcg_at_100_std
      value: -27.238639718923814
    - type: nauc_ndcg_at_10_diff1
      value: 13.16429886726646
    - type: nauc_ndcg_at_10_max
      value: -12.816570276390305
    - type: nauc_ndcg_at_10_std
      value: -27.13129457560619
    - type: nauc_ndcg_at_1_diff1
      value: 16.257792463128126
    - type: nauc_ndcg_at_1_max
      value: -16.164790771610072
    - type: nauc_ndcg_at_1_std
      value: -27.84021734986689
    - type: nauc_ndcg_at_20_diff1
      value: 13.767660163849325
    - type: nauc_ndcg_at_20_max
      value: -13.330392545127982
    - type: nauc_ndcg_at_20_std
      value: -27.655874185287637
    - type: nauc_ndcg_at_3_diff1
      value: 15.379454570465107
    - type: nauc_ndcg_at_3_max
      value: -10.682369832384417
    - type: nauc_ndcg_at_3_std
      value: -26.61546503103021
    - type: nauc_ndcg_at_5_diff1
      value: 13.857194107241847
    - type: nauc_ndcg_at_5_max
      value: -11.585582001386438
    - type: nauc_ndcg_at_5_std
      value: -25.60318972329879
    - type: nauc_precision_at_1000_diff1
      value: 25.196544697410012
    - type: nauc_precision_at_1000_max
      value: 20.85546049013785
    - type: nauc_precision_at_1000_std
      value: 56.11900085120013
    - type: nauc_precision_at_100_diff1
      value: 11.605921153386918
    - type: nauc_precision_at_100_max
      value: 14.521201087528956
    - type: nauc_precision_at_100_std
      value: 17.78762614096395
    - type: nauc_precision_at_10_diff1
      value: 2.9073450747110328
    - type: nauc_precision_at_10_max
      value: -1.7706065742373982
    - type: nauc_precision_at_10_std
      value: -25.127721917434958
    - type: nauc_precision_at_1_diff1
      value: 16.257792463128126
    - type: nauc_precision_at_1_max
      value: -16.164790771610072
    - type: nauc_precision_at_1_std
      value: -27.84021734986689
    - type: nauc_precision_at_20_diff1
      value: 4.945029151806525
    - type: nauc_precision_at_20_max
      value: 1.299254371223885
    - type: nauc_precision_at_20_std
      value: -42.34878406902393
    - type: nauc_precision_at_3_diff1
      value: 17.02535492673917
    - type: nauc_precision_at_3_max
      value: -3.160620615377462
    - type: nauc_precision_at_3_std
      value: -24.392959569235646
    - type: nauc_precision_at_5_diff1
      value: 12.283704585525927
    - type: nauc_precision_at_5_max
      value: -2.860819740357931
    - type: nauc_precision_at_5_std
      value: -19.497494992596568
    - type: nauc_recall_at_1000_diff1
      value: 25.196544697407973
    - type: nauc_recall_at_1000_max
      value: 20.855460490135933
    - type: nauc_recall_at_1000_std
      value: 56.119000851196496
    - type: nauc_recall_at_100_diff1
      value: 11.60592115338627
    - type: nauc_recall_at_100_max
      value: 14.5212010875248
    - type: nauc_recall_at_100_std
      value: 17.787626140957425
    - type: nauc_recall_at_10_diff1
      value: 2.9073450747112304
    - type: nauc_recall_at_10_max
      value: -1.7706065742371515
    - type: nauc_recall_at_10_std
      value: -25.12772191743481
    - type: nauc_recall_at_1_diff1
      value: 16.257792463128126
    - type: nauc_recall_at_1_max
      value: -16.164790771610072
    - type: nauc_recall_at_1_std
      value: -27.84021734986689
    - type: nauc_recall_at_20_diff1
      value: 4.9450291518064935
    - type: nauc_recall_at_20_max
      value: 1.2992543712237186
    - type: nauc_recall_at_20_std
      value: -42.34878406902303
    - type: nauc_recall_at_3_diff1
      value: 17.025354926739237
    - type: nauc_recall_at_3_max
      value: -3.1606206153775016
    - type: nauc_recall_at_3_std
      value: -24.39295956923558
    - type: nauc_recall_at_5_diff1
      value: 12.283704585525939
    - type: nauc_recall_at_5_max
      value: -2.8608197403578512
    - type: nauc_recall_at_5_std
      value: -19.497494992596575
    - type: ndcg_at_1
      value: 44.666
    - type: ndcg_at_10
      value: 68.277
    - type: ndcg_at_100
      value: 69.78
    - type: ndcg_at_1000
      value: 69.78999999999999
    - type: ndcg_at_20
      value: 69.464
    - type: ndcg_at_3
      value: 60.462
    - type: ndcg_at_5
      value: 64.651
    - type: precision_at_1
      value: 44.666
    - type: precision_at_10
      value: 9.339
    - type: precision_at_100
      value: 0.996
    - type: precision_at_1000
      value: 0.1
    - type: precision_at_20
      value: 4.897
    - type: precision_at_3
      value: 24.016000000000002
    - type: precision_at_5
      value: 16.458000000000002
    - type: recall_at_1
      value: 44.666
    - type: recall_at_10
      value: 93.38499999999999
    - type: recall_at_100
      value: 99.57300000000001
    - type: recall_at_1000
      value: 99.644
    - type: recall_at_20
      value: 97.937
    - type: recall_at_3
      value: 72.048
    - type: recall_at_5
      value: 82.28999999999999
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackAndroidRetrieval
      type: mteb/cqadupstack-android
      config: default
      split: test
      revision: f46a197baaae43b4f621051089b82a364682dfeb
    metrics:
    - type: main_score
      value: 57.025000000000006
    - type: map_at_1
      value: 35.67
    - type: map_at_10
      value: 49.816
    - type: map_at_100
      value: 51.465
    - type: map_at_1000
      value: 51.559
    - type: map_at_20
      value: 50.843
    - type: map_at_3
      value: 45.462
    - type: map_at_5
      value: 47.789
    - type: mrr_at_1
      value: 44.77825464949928
    - type: mrr_at_10
      value: 55.787576356245886
    - type: mrr_at_100
      value: 56.4488799265231
    - type: mrr_at_1000
      value: 56.47353697784773
    - type: mrr_at_20
      value: 56.21107253216036
    - type: mrr_at_3
      value: 52.885073915116834
    - type: mrr_at_5
      value: 54.58035288507389
    - type: nauc_map_at_1000_diff1
      value: 50.45823101819382
    - type: nauc_map_at_1000_max
      value: 36.49053295534483
    - type: nauc_map_at_1000_std
      value: -18.526304321886187
    - type: nauc_map_at_100_diff1
      value: 50.4260834410578
    - type: nauc_map_at_100_max
      value: 36.5085073099934
    - type: nauc_map_at_100_std
      value: -18.46644794935817
    - type: nauc_map_at_10_diff1
      value: 50.89883450942742
    - type: nauc_map_at_10_max
      value: 36.04067774200049
    - type: nauc_map_at_10_std
      value: -20.056347095828695
    - type: nauc_map_at_1_diff1
      value: 56.834567406767775
    - type: nauc_map_at_1_max
      value: 32.806861016490686
    - type: nauc_map_at_1_std
      value: -17.50758527738866
    - type: nauc_map_at_20_diff1
      value: 50.5042164434519
    - type: nauc_map_at_20_max
      value: 36.50186920758872
    - type: nauc_map_at_20_std
      value: -18.739559098645316
    - type: nauc_map_at_3_diff1
      value: 51.47192911647498
    - type: nauc_map_at_3_max
      value: 35.30704707609017
    - type: nauc_map_at_3_std
      value: -20.29632792705977
    - type: nauc_map_at_5_diff1
      value: 51.12306422908822
    - type: nauc_map_at_5_max
      value: 35.89975376917192
    - type: nauc_map_at_5_std
      value: -19.828384476366086
    - type: nauc_mrr_at_1000_diff1
      value: 48.849919708933356
    - type: nauc_mrr_at_1000_max
      value: 37.551368642516984
    - type: nauc_mrr_at_1000_std
      value: -17.829333495571873
    - type: nauc_mrr_at_100_diff1
      value: 48.84124005822968
    - type: nauc_mrr_at_100_max
      value: 37.55507214788527
    - type: nauc_mrr_at_100_std
      value: -17.829902708031735
    - type: nauc_mrr_at_10_diff1
      value: 48.75998469903627
    - type: nauc_mrr_at_10_max
      value: 37.38578492482243
    - type: nauc_mrr_at_10_std
      value: -18.49027309110136
    - type: nauc_mrr_at_1_diff1
      value: 52.82147548271261
    - type: nauc_mrr_at_1_max
      value: 38.52107406488729
    - type: nauc_mrr_at_1_std
      value: -15.557810119211657
    - type: nauc_mrr_at_20_diff1
      value: 48.786516207985585
    - type: nauc_mrr_at_20_max
      value: 37.53134866494839
    - type: nauc_mrr_at_20_std
      value: -17.78055242023104
    - type: nauc_mrr_at_3_diff1
      value: 48.72848733815437
    - type: nauc_mrr_at_3_max
      value: 37.62564116429598
    - type: nauc_mrr_at_3_std
      value: -18.63098278761354
    - type: nauc_mrr_at_5_diff1
      value: 48.67198763487669
    - type: nauc_mrr_at_5_max
      value: 37.46200111234106
    - type: nauc_mrr_at_5_std
      value: -18.592288612712576
    - type: nauc_ndcg_at_1000_diff1
      value: 48.75201809702225
    - type: nauc_ndcg_at_1000_max
      value: 37.04967809462886
    - type: nauc_ndcg_at_1000_std
      value: -16.948540945875216
    - type: nauc_ndcg_at_100_diff1
      value: 48.213857924243804
    - type: nauc_ndcg_at_100_max
      value: 36.99860703887876
    - type: nauc_ndcg_at_100_std
      value: -16.420746045271017
    - type: nauc_ndcg_at_10_diff1
      value: 48.7590345342662
    - type: nauc_ndcg_at_10_max
      value: 36.087304891668495
    - type: nauc_ndcg_at_10_std
      value: -20.677784655001727
    - type: nauc_ndcg_at_1_diff1
      value: 52.82147548271261
    - type: nauc_ndcg_at_1_max
      value: 38.52107406488729
    - type: nauc_ndcg_at_1_std
      value: -15.557810119211657
    - type: nauc_ndcg_at_20_diff1
      value: 48.119759046742004
    - type: nauc_ndcg_at_20_max
      value: 36.91858601052183
    - type: nauc_ndcg_at_20_std
      value: -17.315588991460316
    - type: nauc_ndcg_at_3_diff1
      value: 48.35879771694856
    - type: nauc_ndcg_at_3_max
      value: 36.59333419427929
    - type: nauc_ndcg_at_3_std
      value: -19.646763729930917
    - type: nauc_ndcg_at_5_diff1
      value: 48.73702053100838
    - type: nauc_ndcg_at_5_max
      value: 36.2032422359128
    - type: nauc_ndcg_at_5_std
      value: -19.81761218645642
    - type: nauc_precision_at_1000_diff1
      value: -19.23879401783259
    - type: nauc_precision_at_1000_max
      value: -10.334669548312661
    - type: nauc_precision_at_1000_std
      value: 1.8528999887213935
    - type: nauc_precision_at_100_diff1
      value: -17.061064047641576
    - type: nauc_precision_at_100_max
      value: -2.2318557604173557
    - type: nauc_precision_at_100_std
      value: 9.453864069155783
    - type: nauc_precision_at_10_diff1
      value: -0.0250981142012463
    - type: nauc_precision_at_10_max
      value: 15.000297351883034
    - type: nauc_precision_at_10_std
      value: -1.6209044879293661
    - type: nauc_precision_at_1_diff1
      value: 52.82147548271261
    - type: nauc_precision_at_1_max
      value: 38.52107406488729
    - type: nauc_precision_at_1_std
      value: -15.557810119211657
    - type: nauc_precision_at_20_diff1
      value: -9.566950286920978
    - type: nauc_precision_at_20_max
      value: 9.865702753901365
    - type: nauc_precision_at_20_std
      value: 8.87854086185741
    - type: nauc_precision_at_3_diff1
      value: 19.978926078471915
    - type: nauc_precision_at_3_max
      value: 29.135402513527524
    - type: nauc_precision_at_3_std
      value: -12.410877361712942
    - type: nauc_precision_at_5_diff1
      value: 11.602459698883452
    - type: nauc_precision_at_5_max
      value: 24.44724344216036
    - type: nauc_precision_at_5_std
      value: -6.23012846505485
    - type: nauc_recall_at_1000_diff1
      value: 30.5620107082901
    - type: nauc_recall_at_1000_max
      value: 57.90393858174957
    - type: nauc_recall_at_1000_std
      value: 50.27827169570347
    - type: nauc_recall_at_100_diff1
      value: 30.37443399479563
    - type: nauc_recall_at_100_max
      value: 37.75874353752331
    - type: nauc_recall_at_100_std
      value: 10.331635217724585
    - type: nauc_recall_at_10_diff1
      value: 42.50804834678793
    - type: nauc_recall_at_10_max
      value: 32.01676571227172
    - type: nauc_recall_at_10_std
      value: -24.707266416874376
    - type: nauc_recall_at_1_diff1
      value: 56.834567406767775
    - type: nauc_recall_at_1_max
      value: 32.806861016490686
    - type: nauc_recall_at_1_std
      value: -17.50758527738866
    - type: nauc_recall_at_20_diff1
      value: 38.7222771840029
    - type: nauc_recall_at_20_max
      value: 35.62991559107865
    - type: nauc_recall_at_20_std
      value: -8.672399835082256
    - type: nauc_recall_at_3_diff1
      value: 44.63989156943874
    - type: nauc_recall_at_3_max
      value: 32.924250725683954
    - type: nauc_recall_at_3_std
      value: -22.031517542434386
    - type: nauc_recall_at_5_diff1
      value: 43.52398344993421
    - type: nauc_recall_at_5_max
      value: 32.68140834172185
    - type: nauc_recall_at_5_std
      value: -22.07867437121263
    - type: ndcg_at_1
      value: 44.778
    - type: ndcg_at_10
      value: 57.025000000000006
    - type: ndcg_at_100
      value: 62.007
    - type: ndcg_at_1000
      value: 63.11
    - type: ndcg_at_20
      value: 59.301
    - type: ndcg_at_3
      value: 51.162
    - type: ndcg_at_5
      value: 53.684
    - type: precision_at_1
      value: 44.778
    - type: precision_at_10
      value: 11.173
    - type: precision_at_100
      value: 1.7080000000000002
    - type: precision_at_1000
      value: 0.20600000000000002
    - type: precision_at_20
      value: 6.651999999999999
    - type: precision_at_3
      value: 25.130999999999997
    - type: precision_at_5
      value: 18.026
    - type: recall_at_1
      value: 35.67
    - type: recall_at_10
      value: 71.006
    - type: recall_at_100
      value: 91.24
    - type: recall_at_1000
      value: 97.68599999999999
    - type: recall_at_20
      value: 78.869
    - type: recall_at_3
      value: 53.616
    - type: recall_at_5
      value: 61.046
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackEnglishRetrieval
      type: mteb/cqadupstack-english
      config: default
      split: test
      revision: ad9991cb51e31e31e430383c75ffb2885547b5f0
    metrics:
    - type: main_score
      value: 56.93
    - type: map_at_1
      value: 37.869
    - type: map_at_10
      value: 50.651999999999994
    - type: map_at_100
      value: 52.099
    - type: map_at_1000
      value: 52.229000000000006
    - type: map_at_20
      value: 51.471000000000004
    - type: map_at_3
      value: 46.900999999999996
    - type: map_at_5
      value: 49.163000000000004
    - type: mrr_at_1
      value: 48.152866242038215
    - type: mrr_at_10
      value: 57.048781720756324
    - type: mrr_at_100
      value: 57.61447046748723
    - type: mrr_at_1000
      value: 57.64904742638159
    - type: mrr_at_20
      value: 57.39780918212383
    - type: mrr_at_3
      value: 54.80891719745229
    - type: mrr_at_5
      value: 56.28343949044594
    - type: nauc_map_at_1000_diff1
      value: 58.85279432139136
    - type: nauc_map_at_1000_max
      value: 44.27751637558559
    - type: nauc_map_at_1000_std
      value: -15.750083199667806
    - type: nauc_map_at_100_diff1
      value: 58.86033676691407
    - type: nauc_map_at_100_max
      value: 44.19456055171921
    - type: nauc_map_at_100_std
      value: -15.866235670948466
    - type: nauc_map_at_10_diff1
      value: 59.15850189168124
    - type: nauc_map_at_10_max
      value: 43.11472836391707
    - type: nauc_map_at_10_std
      value: -17.744478993375527
    - type: nauc_map_at_1_diff1
      value: 64.04942461321761
    - type: nauc_map_at_1_max
      value: 36.02760504360551
    - type: nauc_map_at_1_std
      value: -20.916663614576407
    - type: nauc_map_at_20_diff1
      value: 58.98751913649348
    - type: nauc_map_at_20_max
      value: 43.747358339703325
    - type: nauc_map_at_20_std
      value: -16.73926017048612
    - type: nauc_map_at_3_diff1
      value: 60.545139674280094
    - type: nauc_map_at_3_max
      value: 41.30484092754499
    - type: nauc_map_at_3_std
      value: -20.449249818528614
    - type: nauc_map_at_5_diff1
      value: 59.60326322666997
    - type: nauc_map_at_5_max
      value: 42.108701221797
    - type: nauc_map_at_5_std
      value: -18.957986608087435
    - type: nauc_mrr_at_1000_diff1
      value: 56.30127401697153
    - type: nauc_mrr_at_1000_max
      value: 47.08483234515321
    - type: nauc_mrr_at_1000_std
      value: -10.314335018294779
    - type: nauc_mrr_at_100_diff1
      value: 56.28727998516319
    - type: nauc_mrr_at_100_max
      value: 47.08137119553827
    - type: nauc_mrr_at_100_std
      value: -10.295734439040498
    - type: nauc_mrr_at_10_diff1
      value: 56.25229630851168
    - type: nauc_mrr_at_10_max
      value: 47.149329681676
    - type: nauc_mrr_at_10_std
      value: -10.598837356654567
    - type: nauc_mrr_at_1_diff1
      value: 59.098651501966394
    - type: nauc_mrr_at_1_max
      value: 46.60615627466452
    - type: nauc_mrr_at_1_std
      value: -10.475650807142516
    - type: nauc_mrr_at_20_diff1
      value: 56.2453798649222
    - type: nauc_mrr_at_20_max
      value: 47.09346599217677
    - type: nauc_mrr_at_20_std
      value: -10.386425082322834
    - type: nauc_mrr_at_3_diff1
      value: 56.75733035936052
    - type: nauc_mrr_at_3_max
      value: 46.94088551304416
    - type: nauc_mrr_at_3_std
      value: -11.483866905681051
    - type: nauc_mrr_at_5_diff1
      value: 56.40006056789708
    - type: nauc_mrr_at_5_max
      value: 46.808130364381846
    - type: nauc_mrr_at_5_std
      value: -11.050122560712222
    - type: nauc_ndcg_at_1000_diff1
      value: 56.60974899528984
    - type: nauc_ndcg_at_1000_max
      value: 46.20688890501171
    - type: nauc_ndcg_at_1000_std
      value: -11.14222381973439
    - type: nauc_ndcg_at_100_diff1
      value: 56.677945515470675
    - type: nauc_ndcg_at_100_max
      value: 46.001596072553404
    - type: nauc_ndcg_at_100_std
      value: -11.229044974791337
    - type: nauc_ndcg_at_10_diff1
      value: 57.1066442501231
    - type: nauc_ndcg_at_10_max
      value: 45.542982262967776
    - type: nauc_ndcg_at_10_std
      value: -14.273638238311195
    - type: nauc_ndcg_at_1_diff1
      value: 59.098651501966394
    - type: nauc_ndcg_at_1_max
      value: 46.60615627466452
    - type: nauc_ndcg_at_1_std
      value: -10.475650807142516
    - type: nauc_ndcg_at_20_diff1
      value: 56.851307181340694
    - type: nauc_ndcg_at_20_max
      value: 45.84417755460993
    - type: nauc_ndcg_at_20_std
      value: -12.926633494308371
    - type: nauc_ndcg_at_3_diff1
      value: 57.423753276241754
    - type: nauc_ndcg_at_3_max
      value: 45.1658528352273
    - type: nauc_ndcg_at_3_std
      value: -15.041500407672178
    - type: nauc_ndcg_at_5_diff1
      value: 57.366735747016584
    - type: nauc_ndcg_at_5_max
      value: 44.754486357586316
    - type: nauc_ndcg_at_5_std
      value: -15.100632526050441
    - type: nauc_precision_at_1000_diff1
      value: -23.32973690238293
    - type: nauc_precision_at_1000_max
      value: 9.122165441089374
    - type: nauc_precision_at_1000_std
      value: 32.082444098667565
    - type: nauc_precision_at_100_diff1
      value: -16.218615616263428
    - type: nauc_precision_at_100_max
      value: 19.44437302773441
    - type: nauc_precision_at_100_std
      value: 35.248811470691166
    - type: nauc_precision_at_10_diff1
      value: 1.0766468144861965
    - type: nauc_precision_at_10_max
      value: 30.491892916282236
    - type: nauc_precision_at_10_std
      value: 18.538876410079585
    - type: nauc_precision_at_1_diff1
      value: 59.098651501966394
    - type: nauc_precision_at_1_max
      value: 46.60615627466452
    - type: nauc_precision_at_1_std
      value: -10.475650807142516
    - type: nauc_precision_at_20_diff1
      value: -6.769874545877082
    - type: nauc_precision_at_20_max
      value: 26.352774891191004
    - type: nauc_precision_at_20_std
      value: 26.150734923942952
    - type: nauc_precision_at_3_diff1
      value: 23.74601942735032
    - type: nauc_precision_at_3_max
      value: 39.71043044078846
    - type: nauc_precision_at_3_std
      value: 3.161463247727185
    - type: nauc_precision_at_5_diff1
      value: 11.589849872978208
    - type: nauc_precision_at_5_max
      value: 34.355473407777296
    - type: nauc_precision_at_5_std
      value: 10.0662074493734
    - type: nauc_recall_at_1000_diff1
      value: 44.20612579552725
    - type: nauc_recall_at_1000_max
      value: 54.50563586814392
    - type: nauc_recall_at_1000_std
      value: 29.37098358130919
    - type: nauc_recall_at_100_diff1
      value: 46.991905821496225
    - type: nauc_recall_at_100_max
      value: 45.677355517440446
    - type: nauc_recall_at_100_std
      value: 8.193115293674246
    - type: nauc_recall_at_10_diff1
      value: 51.021956806545575
    - type: nauc_recall_at_10_max
      value: 42.39780880270869
    - type: nauc_recall_at_10_std
      value: -14.372872090525025
    - type: nauc_recall_at_1_diff1
      value: 64.04942461321761
    - type: nauc_recall_at_1_max
      value: 36.02760504360551
    - type: nauc_recall_at_1_std
      value: -20.916663614576407
    - type: nauc_recall_at_20_diff1
      value: 49.330317036362736
    - type: nauc_recall_at_20_max
      value: 43.82370541895915
    - type: nauc_recall_at_20_std
      value: -7.676142813819095
    - type: nauc_recall_at_3_diff1
      value: 56.15563158128648
    - type: nauc_recall_at_3_max
      value: 39.776800175069496
    - type: nauc_recall_at_3_std
      value: -21.67535047518367
    - type: nauc_recall_at_5_diff1
      value: 53.55725212243435
    - type: nauc_recall_at_5_max
      value: 39.639229625237746
    - type: nauc_recall_at_5_std
      value: -18.537472489671433
    - type: ndcg_at_1
      value: 48.153
    - type: ndcg_at_10
      value: 56.93
    - type: ndcg_at_100
      value: 61.041999999999994
    - type: ndcg_at_1000
      value: 62.71600000000001
    - type: ndcg_at_20
      value: 58.626999999999995
    - type: ndcg_at_3
      value: 52.437999999999995
    - type: ndcg_at_5
      value: 54.774
    - type: precision_at_1
      value: 48.153
    - type: precision_at_10
      value: 10.93
    - type: precision_at_100
      value: 1.669
    - type: precision_at_1000
      value: 0.213
    - type: precision_at_20
      value: 6.382000000000001
    - type: precision_at_3
      value: 25.796000000000003
    - type: precision_at_5
      value: 18.407999999999998
    - type: recall_at_1
      value: 37.869
    - type: recall_at_10
      value: 67.514
    - type: recall_at_100
      value: 84.454
    - type: recall_at_1000
      value: 94.356
    - type: recall_at_20
      value: 73.558
    - type: recall_at_3
      value: 53.559
    - type: recall_at_5
      value: 60.475
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackGamingRetrieval
      type: mteb/cqadupstack-gaming
      config: default
      split: test
      revision: 4885aa143210c98657558c04aaf3dc47cfb54340
    metrics:
    - type: main_score
      value: 67.253
    - type: map_at_1
      value: 46.905
    - type: map_at_10
      value: 61.332
    - type: map_at_100
      value: 62.304
    - type: map_at_1000
      value: 62.334
    - type: map_at_20
      value: 61.964
    - type: map_at_3
      value: 58.042
    - type: map_at_5
      value: 59.882000000000005
    - type: mrr_at_1
      value: 53.47962382445141
    - type: mrr_at_10
      value: 64.39956212370015
    - type: mrr_at_100
      value: 64.95557189125634
    - type: mrr_at_1000
      value: 64.96848596592983
    - type: mrr_at_20
      value: 64.77428822572568
    - type: mrr_at_3
      value: 62.309299895506896
    - type: mrr_at_5
      value: 63.54440961337527
    - type: nauc_map_at_1000_diff1
      value: 56.74686837364893
    - type: nauc_map_at_1000_max
      value: 37.37480368876817
    - type: nauc_map_at_1000_std
      value: -10.049421617657124
    - type: nauc_map_at_100_diff1
      value: 56.72313143831275
    - type: nauc_map_at_100_max
      value: 37.35797555204418
    - type: nauc_map_at_100_std
      value: -10.049812301974452
    - type: nauc_map_at_10_diff1
      value: 56.68397120600094
    - type: nauc_map_at_10_max
      value: 36.59842978269273
    - type: nauc_map_at_10_std
      value: -11.174804244499098
    - type: nauc_map_at_1_diff1
      value: 61.94214953873164
    - type: nauc_map_at_1_max
      value: 28.119092174242382
    - type: nauc_map_at_1_std
      value: -14.419629681905278
    - type: nauc_map_at_20_diff1
      value: 56.66822667045707
    - type: nauc_map_at_20_max
      value: 37.19179210659321
    - type: nauc_map_at_20_std
      value: -10.36424574922098
    - type: nauc_map_at_3_diff1
      value: 56.786004222951966
    - type: nauc_map_at_3_max
      value: 34.409125163057354
    - type: nauc_map_at_3_std
      value: -12.308681065089702
    - type: nauc_map_at_5_diff1
      value: 56.837122717249855
    - type: nauc_map_at_5_max
      value: 35.70069180549282
    - type: nauc_map_at_5_std
      value: -12.19154238352126
    - type: nauc_mrr_at_1000_diff1
      value: 57.03608286201278
    - type: nauc_mrr_at_1000_max
      value: 39.15777651816965
    - type: nauc_mrr_at_1000_std
      value: -8.45524348928121
    - type: nauc_mrr_at_100_diff1
      value: 57.03051889095766
    - type: nauc_mrr_at_100_max
      value: 39.168900323859
    - type: nauc_mrr_at_100_std
      value: -8.439862972545644
    - type: nauc_mrr_at_10_diff1
      value: 56.848642658414775
    - type: nauc_mrr_at_10_max
      value: 39.11801407771557
    - type: nauc_mrr_at_10_std
      value: -8.678625365653245
    - type: nauc_mrr_at_1_diff1
      value: 61.1124527741601
    - type: nauc_mrr_at_1_max
      value: 36.080048505155865
    - type: nauc_mrr_at_1_std
      value: -10.584194474752584
    - type: nauc_mrr_at_20_diff1
      value: 56.878714270983146
    - type: nauc_mrr_at_20_max
      value: 39.16569382719707
    - type: nauc_mrr_at_20_std
      value: -8.447245465078893
    - type: nauc_mrr_at_3_diff1
      value: 56.87172734333986
    - type: nauc_mrr_at_3_max
      value: 39.07882270376788
    - type: nauc_mrr_at_3_std
      value: -9.069457598400062
    - type: nauc_mrr_at_5_diff1
      value: 56.82487051170517
    - type: nauc_mrr_at_5_max
      value: 39.030878651662796
    - type: nauc_mrr_at_5_std
      value: -9.076518259406917
    - type: nauc_ndcg_at_1000_diff1
      value: 56.082240909091695
    - type: nauc_ndcg_at_1000_max
      value: 39.699264232007025
    - type: nauc_ndcg_at_1000_std
      value: -7.502941002933741
    - type: nauc_ndcg_at_100_diff1
      value: 55.887513398861955
    - type: nauc_ndcg_at_100_max
      value: 39.847450141736395
    - type: nauc_ndcg_at_100_std
      value: -7.146894645593031
    - type: nauc_ndcg_at_10_diff1
      value: 55.15467572394677
    - type: nauc_ndcg_at_10_max
      value: 38.97265748975791
    - type: nauc_ndcg_at_10_std
      value: -9.4670794339538
    - type: nauc_ndcg_at_1_diff1
      value: 61.1124527741601
    - type: nauc_ndcg_at_1_max
      value: 36.080048505155865
    - type: nauc_ndcg_at_1_std
      value: -10.584194474752584
    - type: nauc_ndcg_at_20_diff1
      value: 55.15513104937557
    - type: nauc_ndcg_at_20_max
      value: 39.66296704562037
    - type: nauc_ndcg_at_20_std
      value: -7.847800655967109
    - type: nauc_ndcg_at_3_diff1
      value: 54.96185776120714
    - type: nauc_ndcg_at_3_max
      value: 37.00790660301803
    - type: nauc_ndcg_at_3_std
      value: -10.547349631779593
    - type: nauc_ndcg_at_5_diff1
      value: 55.292986134183764
    - type: nauc_ndcg_at_5_max
      value: 38.12541620211435
    - type: nauc_ndcg_at_5_std
      value: -10.961954651898877
    - type: nauc_precision_at_1000_diff1
      value: -17.737775083152922
    - type: nauc_precision_at_1000_max
      value: 21.575992446429407
    - type: nauc_precision_at_1000_std
      value: 30.76555260404715
    - type: nauc_precision_at_100_diff1
      value: -17.3761536797116
    - type: nauc_precision_at_100_max
      value: 23.455151994000513
    - type: nauc_precision_at_100_std
      value: 30.66476060812044
    - type: nauc_precision_at_10_diff1
      value: 0.37712699076668355
    - type: nauc_precision_at_10_max
      value: 31.298133911984248
    - type: nauc_precision_at_10_std
      value: 16.134374567323214
    - type: nauc_precision_at_1_diff1
      value: 61.1124527741601
    - type: nauc_precision_at_1_max
      value: 36.080048505155865
    - type: nauc_precision_at_1_std
      value: -10.584194474752584
    - type: nauc_precision_at_20_diff1
      value: -7.697609516072893
    - type: nauc_precision_at_20_max
      value: 30.392978129152638
    - type: nauc_precision_at_20_std
      value: 25.297979676649902
    - type: nauc_precision_at_3_diff1
      value: 21.920115701694172
    - type: nauc_precision_at_3_max
      value: 35.916002988740644
    - type: nauc_precision_at_3_std
      value: 3.192816307982428
    - type: nauc_precision_at_5_diff1
      value: 12.416994377124743
    - type: nauc_precision_at_5_max
      value: 34.60793433800759
    - type: nauc_precision_at_5_std
      value: 7.681539417199799
    - type: nauc_recall_at_1000_diff1
      value: 45.05841406616179
    - type: nauc_recall_at_1000_max
      value: 84.01729859779441
    - type: nauc_recall_at_1000_std
      value: 70.81952441677544
    - type: nauc_recall_at_100_diff1
      value: 47.82912442332592
    - type: nauc_recall_at_100_max
      value: 61.538854248032905
    - type: nauc_recall_at_100_std
      value: 31.507749555394742
    - type: nauc_recall_at_10_diff1
      value: 46.23707108341979
    - type: nauc_recall_at_10_max
      value: 40.14549188124033
    - type: nauc_recall_at_10_std
      value: -8.418378388855976
    - type: nauc_recall_at_1_diff1
      value: 61.94214953873164
    - type: nauc_recall_at_1_max
      value: 28.119092174242382
    - type: nauc_recall_at_1_std
      value: -14.419629681905278
    - type: nauc_recall_at_20_diff1
      value: 43.5874302201068
    - type: nauc_recall_at_20_max
      value: 46.94504592203577
    - type: nauc_recall_at_20_std
      value: 3.913410811827146
    - type: nauc_recall_at_3_diff1
      value: 49.63064701945406
    - type: nauc_recall_at_3_max
      value: 35.29572226414386
    - type: nauc_recall_at_3_std
      value: -12.297827741460027
    - type: nauc_recall_at_5_diff1
      value: 48.601651302714224
    - type: nauc_recall_at_5_max
      value: 37.38710560640659
    - type: nauc_recall_at_5_std
      value: -13.458409202400507
    - type: ndcg_at_1
      value: 53.480000000000004
    - type: ndcg_at_10
      value: 67.253
    - type: ndcg_at_100
      value: 70.648
    - type: ndcg_at_1000
      value: 71.139
    - type: ndcg_at_20
      value: 68.905
    - type: ndcg_at_3
      value: 62.178
    - type: ndcg_at_5
      value: 64.64800000000001
    - type: precision_at_1
      value: 53.480000000000004
    - type: precision_at_10
      value: 10.696
    - type: precision_at_100
      value: 1.325
    - type: precision_at_1000
      value: 0.13899999999999998
    - type: precision_at_20
      value: 5.884
    - type: precision_at_3
      value: 27.794999999999998
    - type: precision_at_5
      value: 18.708
    - type: recall_at_1
      value: 46.905
    - type: recall_at_10
      value: 81.234
    - type: recall_at_100
      value: 95.489
    - type: recall_at_1000
      value: 98.729
    - type: recall_at_20
      value: 87.29400000000001
    - type: recall_at_3
      value: 67.869
    - type: recall_at_5
      value: 73.896
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackGisRetrieval
      type: mteb/cqadupstack-gis
      config: default
      split: test
      revision: 5003b3064772da1887988e05400cf3806fe491f2
    metrics:
    - type: main_score
      value: 46.397
    - type: map_at_1
      value: 30.613
    - type: map_at_10
      value: 40.581
    - type: map_at_100
      value: 41.660000000000004
    - type: map_at_1000
      value: 41.721000000000004
    - type: map_at_20
      value: 41.211999999999996
    - type: map_at_3
      value: 37.32
    - type: map_at_5
      value: 39.114
    - type: mrr_at_1
      value: 33.220338983050844
    - type: mrr_at_10
      value: 42.83718948973182
    - type: mrr_at_100
      value: 43.71836325492362
    - type: mrr_at_1000
      value: 43.76175841571598
    - type: mrr_at_20
      value: 43.384811953015166
    - type: mrr_at_3
      value: 39.830508474576256
    - type: mrr_at_5
      value: 41.54802259887001
    - type: nauc_map_at_1000_diff1
      value: 42.6225958477453
    - type: nauc_map_at_1000_max
      value: 28.013356866974238
    - type: nauc_map_at_1000_std
      value: -9.409667321411026
    - type: nauc_map_at_100_diff1
      value: 42.610412175224766
    - type: nauc_map_at_100_max
      value: 28.002610966435736
    - type: nauc_map_at_100_std
      value: -9.411570910136719
    - type: nauc_map_at_10_diff1
      value: 42.63151134672704
    - type: nauc_map_at_10_max
      value: 28.001496131016022
    - type: nauc_map_at_10_std
      value: -9.67772644457909
    - type: nauc_map_at_1_diff1
      value: 46.31023790327735
    - type: nauc_map_at_1_max
      value: 24.2900776546879
    - type: nauc_map_at_1_std
      value: -11.905089868017578
    - type: nauc_map_at_20_diff1
      value: 42.6522287088466
    - type: nauc_map_at_20_max
      value: 27.975313282087043
    - type: nauc_map_at_20_std
      value: -9.550553164224084
    - type: nauc_map_at_3_diff1
      value: 43.272779420270226
    - type: nauc_map_at_3_max
      value: 26.92288244998244
    - type: nauc_map_at_3_std
      value: -10.575038389958834
    - type: nauc_map_at_5_diff1
      value: 42.58131102442881
    - type: nauc_map_at_5_max
      value: 27.04453513629861
    - type: nauc_map_at_5_std
      value: -10.317573458025175
    - type: nauc_mrr_at_1000_diff1
      value: 41.126210961719636
    - type: nauc_mrr_at_1000_max
      value: 28.513261505932054
    - type: nauc_mrr_at_1000_std
      value: -8.546982260677629
    - type: nauc_mrr_at_100_diff1
      value: 41.110923675787234
    - type: nauc_mrr_at_100_max
      value: 28.52042510810816
    - type: nauc_mrr_at_100_std
      value: -8.534554512496843
    - type: nauc_mrr_at_10_diff1
      value: 41.07534061242193
    - type: nauc_mrr_at_10_max
      value: 28.44682429205697
    - type: nauc_mrr_at_10_std
      value: -8.6819795408583
    - type: nauc_mrr_at_1_diff1
      value: 44.40023434506226
    - type: nauc_mrr_at_1_max
      value: 25.9478208158475
    - type: nauc_mrr_at_1_std
      value: -10.872665260136657
    - type: nauc_mrr_at_20_diff1
      value: 41.146798233387074
    - type: nauc_mrr_at_20_max
      value: 28.517336935279054
    - type: nauc_mrr_at_20_std
      value: -8.580094403841978
    - type: nauc_mrr_at_3_diff1
      value: 41.60309522639159
    - type: nauc_mrr_at_3_max
      value: 28.379418612638734
    - type: nauc_mrr_at_3_std
      value: -9.263458517583244
    - type: nauc_mrr_at_5_diff1
      value: 40.99565866982568
    - type: nauc_mrr_at_5_max
      value: 27.90866498875212
    - type: nauc_mrr_at_5_std
      value: -8.941725041767588
    - type: nauc_ndcg_at_1000_diff1
      value: 41.11051620257291
    - type: nauc_ndcg_at_1000_max
      value: 29.70811129532719
    - type: nauc_ndcg_at_1000_std
      value: -7.127215646258767
    - type: nauc_ndcg_at_100_diff1
      value: 40.63555558695194
    - type: nauc_ndcg_at_100_max
      value: 29.701486964402413
    - type: nauc_ndcg_at_100_std
      value: -6.577078704400861
    - type: nauc_ndcg_at_10_diff1
      value: 40.87142841339465
    - type: nauc_ndcg_at_10_max
      value: 29.704589449676533
    - type: nauc_ndcg_at_10_std
      value: -7.674397553684968
    - type: nauc_ndcg_at_1_diff1
      value: 44.40023434506226
    - type: nauc_ndcg_at_1_max
      value: 25.9478208158475
    - type: nauc_ndcg_at_1_std
      value: -10.872665260136657
    - type: nauc_ndcg_at_20_diff1
      value: 41.06323938303467
    - type: nauc_ndcg_at_20_max
      value: 29.883715521818203
    - type: nauc_ndcg_at_20_std
      value: -7.155761930055846
    - type: nauc_ndcg_at_3_diff1
      value: 41.935479029537156
    - type: nauc_ndcg_at_3_max
      value: 28.171952324901135
    - type: nauc_ndcg_at_3_std
      value: -9.737703474161384
    - type: nauc_ndcg_at_5_diff1
      value: 40.69403623214395
    - type: nauc_ndcg_at_5_max
      value: 27.702311421182756
    - type: nauc_ndcg_at_5_std
      value: -9.060968201824112
    - type: nauc_precision_at_1000_diff1
      value: -8.885096064850758
    - type: nauc_precision_at_1000_max
      value: 14.053447868468186
    - type: nauc_precision_at_1000_std
      value: 12.07987711511724
    - type: nauc_precision_at_100_diff1
      value: 2.3188506683364287
    - type: nauc_precision_at_100_max
      value: 22.080025207013655
    - type: nauc_precision_at_100_std
      value: 14.172840329817307
    - type: nauc_precision_at_10_diff1
      value: 24.9332547479345
    - type: nauc_precision_at_10_max
      value: 34.6422733091986
    - type: nauc_precision_at_10_std
      value: 1.9970789498947206
    - type: nauc_precision_at_1_diff1
      value: 44.40023434506226
    - type: nauc_precision_at_1_max
      value: 25.9478208158475
    - type: nauc_precision_at_1_std
      value: -10.872665260136657
    - type: nauc_precision_at_20_diff1
      value: 20.640050910422755
    - type: nauc_precision_at_20_max
      value: 32.260405497760615
    - type: nauc_precision_at_20_std
      value: 6.854997919374335
    - type: nauc_precision_at_3_diff1
      value: 33.29459667683485
    - type: nauc_precision_at_3_max
      value: 32.151627242504325
    - type: nauc_precision_at_3_std
      value: -5.8202369823669855
    - type: nauc_precision_at_5_diff1
      value: 28.763772683866794
    - type: nauc_precision_at_5_max
      value: 31.392059038257553
    - type: nauc_precision_at_5_std
      value: -3.9737244392531172
    - type: nauc_recall_at_1000_diff1
      value: 26.491178998164894
    - type: nauc_recall_at_1000_max
      value: 53.78324098258691
    - type: nauc_recall_at_1000_std
      value: 22.795807409776284
    - type: nauc_recall_at_100_diff1
      value: 27.100846383184855
    - type: nauc_recall_at_100_max
      value: 36.26211685620019
    - type: nauc_recall_at_100_std
      value: 12.001840836651729
    - type: nauc_recall_at_10_diff1
      value: 35.281252536584226
    - type: nauc_recall_at_10_max
      value: 34.13064097658273
    - type: nauc_recall_at_10_std
      value: -1.238221844846595
    - type: nauc_recall_at_1_diff1
      value: 46.31023790327735
    - type: nauc_recall_at_1_max
      value: 24.2900776546879
    - type: nauc_recall_at_1_std
      value: -11.905089868017578
    - type: nauc_recall_at_20_diff1
      value: 35.29612485423622
    - type: nauc_recall_at_20_max
      value: 36.059880890712606
    - type: nauc_recall_at_20_std
      value: 2.0708009945980916
    - type: nauc_recall_at_3_diff1
      value: 39.33916378398866
    - type: nauc_recall_at_3_max
      value: 28.825178871677544
    - type: nauc_recall_at_3_std
      value: -8.391711028859733
    - type: nauc_recall_at_5_diff1
      value: 35.394135184248086
    - type: nauc_recall_at_5_max
      value: 27.370010171655295
    - type: nauc_recall_at_5_std
      value: -6.342877659046013
    - type: ndcg_at_1
      value: 33.22
    - type: ndcg_at_10
      value: 46.397
    - type: ndcg_at_100
      value: 51.510999999999996
    - type: ndcg_at_1000
      value: 52.941
    - type: ndcg_at_20
      value: 48.614000000000004
    - type: ndcg_at_3
      value: 40.066
    - type: ndcg_at_5
      value: 43.086
    - type: precision_at_1
      value: 33.22
    - type: precision_at_10
      value: 7.153
    - type: precision_at_100
      value: 1.028
    - type: precision_at_1000
      value: 0.11800000000000001
    - type: precision_at_20
      value: 4.1129999999999995
    - type: precision_at_3
      value: 16.949
    - type: precision_at_5
      value: 11.932
    - type: recall_at_1
      value: 30.613
    - type: recall_at_10
      value: 62.248000000000005
    - type: recall_at_100
      value: 85.311
    - type: recall_at_1000
      value: 95.88799999999999
    - type: recall_at_20
      value: 70.729
    - type: recall_at_3
      value: 45.104
    - type: recall_at_5
      value: 52.370000000000005
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackMathematicaRetrieval
      type: mteb/cqadupstack-mathematica
      config: default
      split: test
      revision: 90fceea13679c63fe563ded68f3b6f06e50061de
    metrics:
    - type: main_score
      value: 39.528999999999996
    - type: map_at_1
      value: 22.289
    - type: map_at_10
      value: 33.159
    - type: map_at_100
      value: 34.544999999999995
    - type: map_at_1000
      value: 34.657
    - type: map_at_20
      value: 33.946
    - type: map_at_3
      value: 29.877
    - type: map_at_5
      value: 31.789
    - type: mrr_at_1
      value: 27.860696517412936
    - type: mrr_at_10
      value: 38.592454394693185
    - type: mrr_at_100
      value: 39.532435897754596
    - type: mrr_at_1000
      value: 39.58977434786168
    - type: mrr_at_20
      value: 39.18675071024776
    - type: mrr_at_3
      value: 35.96600331674959
    - type: mrr_at_5
      value: 37.526948590381416
    - type: nauc_map_at_1000_diff1
      value: 33.700166326733495
    - type: nauc_map_at_1000_max
      value: 20.881755159195087
    - type: nauc_map_at_1000_std
      value: -3.3430462158114675
    - type: nauc_map_at_100_diff1
      value: 33.692093684241065
    - type: nauc_map_at_100_max
      value: 20.906418728277437
    - type: nauc_map_at_100_std
      value: -3.3316697944388443
    - type: nauc_map_at_10_diff1
      value: 33.42287630575565
    - type: nauc_map_at_10_max
      value: 20.50001954371251
    - type: nauc_map_at_10_std
      value: -4.08460043500711
    - type: nauc_map_at_1_diff1
      value: 37.87404744244711
    - type: nauc_map_at_1_max
      value: 19.670953538008504
    - type: nauc_map_at_1_std
      value: -6.429774614333435
    - type: nauc_map_at_20_diff1
      value: 33.60771917466459
    - type: nauc_map_at_20_max
      value: 20.708044731830018
    - type: nauc_map_at_20_std
      value: -3.6069971679953143
    - type: nauc_map_at_3_diff1
      value: 33.65349486102774
    - type: nauc_map_at_3_max
      value: 19.627398723335993
    - type: nauc_map_at_3_std
      value: -4.306026212618319
    - type: nauc_map_at_5_diff1
      value: 33.471450513985964
    - type: nauc_map_at_5_max
      value: 19.948552824819032
    - type: nauc_map_at_5_std
      value: -4.923599608990918
    - type: nauc_mrr_at_1000_diff1
      value: 32.662151329963095
    - type: nauc_mrr_at_1000_max
      value: 22.537786156087673
    - type: nauc_mrr_at_1000_std
      value: -2.7960608938625215
    - type: nauc_mrr_at_100_diff1
      value: 32.65867171998483
    - type: nauc_mrr_at_100_max
      value: 22.547865954292774
    - type: nauc_mrr_at_100_std
      value: -2.801012467040567
    - type: nauc_mrr_at_10_diff1
      value: 32.544025707175926
    - type: nauc_mrr_at_10_max
      value: 22.602412903085646
    - type: nauc_mrr_at_10_std
      value: -3.0158656805804602
    - type: nauc_mrr_at_1_diff1
      value: 36.968863725891985
    - type: nauc_mrr_at_1_max
      value: 22.042028260738334
    - type: nauc_mrr_at_1_std
      value: -4.81746524838004
    - type: nauc_mrr_at_20_diff1
      value: 32.6425264960166
    - type: nauc_mrr_at_20_max
      value: 22.513542321494686
    - type: nauc_mrr_at_20_std
      value: -2.8764217789260575
    - type: nauc_mrr_at_3_diff1
      value: 32.50201126992818
    - type: nauc_mrr_at_3_max
      value: 22.128017930298302
    - type: nauc_mrr_at_3_std
      value: -3.023665576028868
    - type: nauc_mrr_at_5_diff1
      value: 32.56418157013767
    - type: nauc_mrr_at_5_max
      value: 22.05870005229312
    - type: nauc_mrr_at_5_std
      value: -3.5021924901272863
    - type: nauc_ndcg_at_1000_diff1
      value: 32.74240275632584
    - type: nauc_ndcg_at_1000_max
      value: 22.404494093544148
    - type: nauc_ndcg_at_1000_std
      value: -0.5292268805090566
    - type: nauc_ndcg_at_100_diff1
      value: 32.39837105476146
    - type: nauc_ndcg_at_100_max
      value: 22.79204625219021
    - type: nauc_ndcg_at_100_std
      value: -0.3490651737152355
    - type: nauc_ndcg_at_10_diff1
      value: 31.932581950709647
    - type: nauc_ndcg_at_10_max
      value: 21.779867741726864
    - type: nauc_ndcg_at_10_std
      value: -2.6923178974285857
    - type: nauc_ndcg_at_1_diff1
      value: 36.968863725891985
    - type: nauc_ndcg_at_1_max
      value: 22.042028260738334
    - type: nauc_ndcg_at_1_std
      value: -4.81746524838004
    - type: nauc_ndcg_at_20_diff1
      value: 32.463586670511226
    - type: nauc_ndcg_at_20_max
      value: 22.140858428394843
    - type: nauc_ndcg_at_20_std
      value: -1.4367590351530557
    - type: nauc_ndcg_at_3_diff1
      value: 32.446170362942084
    - type: nauc_ndcg_at_3_max
      value: 20.60928390930364
    - type: nauc_ndcg_at_3_std
      value: -3.468700146234719
    - type: nauc_ndcg_at_5_diff1
      value: 32.162455412182865
    - type: nauc_ndcg_at_5_max
      value: 20.725999446060232
    - type: nauc_ndcg_at_5_std
      value: -4.274903425807673
    - type: nauc_precision_at_1000_diff1
      value: -1.7949376725223287
    - type: nauc_precision_at_1000_max
      value: 4.138926678307252
    - type: nauc_precision_at_1000_std
      value: 5.718976977950761
    - type: nauc_precision_at_100_diff1
      value: 6.815844234312567
    - type: nauc_precision_at_100_max
      value: 15.267630374047453
    - type: nauc_precision_at_100_std
      value: 10.648732358170012
    - type: nauc_precision_at_10_diff1
      value: 18.776246678630283
    - type: nauc_precision_at_10_max
      value: 20.677245431024357
    - type: nauc_precision_at_10_std
      value: 1.6530753958695428
    - type: nauc_precision_at_1_diff1
      value: 36.968863725891985
    - type: nauc_precision_at_1_max
      value: 22.042028260738334
    - type: nauc_precision_at_1_std
      value: -4.81746524838004
    - type: nauc_precision_at_20_diff1
      value: 16.901118214014854
    - type: nauc_precision_at_20_max
      value: 20.321433804879973
    - type: nauc_precision_at_20_std
      value: 6.464565628780512
    - type: nauc_precision_at_3_diff1
      value: 25.438322928150715
    - type: nauc_precision_at_3_max
      value: 21.513381450535192
    - type: nauc_precision_at_3_std
      value: -1.0164220255846312
    - type: nauc_precision_at_5_diff1
      value: 22.374520350110284
    - type: nauc_precision_at_5_max
      value: 20.541307175039307
    - type: nauc_precision_at_5_std
      value: -2.6340396442123537
    - type: nauc_recall_at_1000_diff1
      value: 24.96791522787828
    - type: nauc_recall_at_1000_max
      value: 28.234314683043806
    - type: nauc_recall_at_1000_std
      value: 40.696299617721635
    - type: nauc_recall_at_100_diff1
      value: 23.613948951560566
    - type: nauc_recall_at_100_max
      value: 25.980432165003002
    - type: nauc_recall_at_100_std
      value: 13.815393892614894
    - type: nauc_recall_at_10_diff1
      value: 26.08578893691453
    - type: nauc_recall_at_10_max
      value: 21.68887563256401
    - type: nauc_recall_at_10_std
      value: 0.3183582141083137
    - type: nauc_recall_at_1_diff1
      value: 37.87404744244711
    - type: nauc_recall_at_1_max
      value: 19.670953538008504
    - type: nauc_recall_at_1_std
      value: -6.429774614333435
    - type: nauc_recall_at_20_diff1
      value: 26.962834137152473
    - type: nauc_recall_at_20_max
      value: 22.164116014019815
    - type: nauc_recall_at_20_std
      value: 4.67553525902973
    - type: nauc_recall_at_3_diff1
      value: 28.282766004526692
    - type: nauc_recall_at_3_max
      value: 19.21433271344623
    - type: nauc_recall_at_3_std
      value: -1.7579654801836264
    - type: nauc_recall_at_5_diff1
      value: 27.31884901762613
    - type: nauc_recall_at_5_max
      value: 19.089489857779846
    - type: nauc_recall_at_5_std
      value: -3.8031906054652667
    - type: ndcg_at_1
      value: 27.861000000000004
    - type: ndcg_at_10
      value: 39.528999999999996
    - type: ndcg_at_100
      value: 45.424
    - type: ndcg_at_1000
      value: 47.682
    - type: ndcg_at_20
      value: 41.967
    - type: ndcg_at_3
      value: 34.083999999999996
    - type: ndcg_at_5
      value: 36.773
    - type: precision_at_1
      value: 27.861000000000004
    - type: precision_at_10
      value: 7.338
    - type: precision_at_100
      value: 1.172
    - type: precision_at_1000
      value: 0.147
    - type: precision_at_20
      value: 4.415
    - type: precision_at_3
      value: 16.833000000000002
    - type: precision_at_5
      value: 12.113999999999999
    - type: recall_at_1
      value: 22.289
    - type: recall_at_10
      value: 53.559
    - type: recall_at_100
      value: 78.521
    - type: recall_at_1000
      value: 94.13
    - type: recall_at_20
      value: 61.986
    - type: recall_at_3
      value: 38.269999999999996
    - type: recall_at_5
      value: 45.336
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackPhysicsRetrieval
      type: mteb/cqadupstack-physics
      config: default
      split: test
      revision: 79531abbd1fb92d06c6d6315a0cbbbf5bb247ea4
    metrics:
    - type: main_score
      value: 54.004
    - type: map_at_1
      value: 33.586
    - type: map_at_10
      value: 47.342
    - type: map_at_100
      value: 48.823
    - type: map_at_1000
      value: 48.919000000000004
    - type: map_at_20
      value: 48.22
    - type: map_at_3
      value: 43.614999999999995
    - type: map_at_5
      value: 45.749
    - type: mrr_at_1
      value: 41.48219441770934
    - type: mrr_at_10
      value: 52.86203156270527
    - type: mrr_at_100
      value: 53.707246266591255
    - type: mrr_at_1000
      value: 53.73489176472194
    - type: mrr_at_20
      value: 53.44504144846516
    - type: mrr_at_3
      value: 50.56143727943533
    - type: mrr_at_5
      value: 51.96663458453635
    - type: nauc_map_at_1000_diff1
      value: 50.16735144466837
    - type: nauc_map_at_1000_max
      value: 30.130457323041902
    - type: nauc_map_at_1000_std
      value: -18.910770726198383
    - type: nauc_map_at_100_diff1
      value: 50.170273630833286
    - type: nauc_map_at_100_max
      value: 30.137603210111934
    - type: nauc_map_at_100_std
      value: -18.93078710897879
    - type: nauc_map_at_10_diff1
      value: 49.995799867485076
    - type: nauc_map_at_10_max
      value: 29.626149915961854
    - type: nauc_map_at_10_std
      value: -19.70118715989913
    - type: nauc_map_at_1_diff1
      value: 56.10337790434511
    - type: nauc_map_at_1_max
      value: 26.249897485765477
    - type: nauc_map_at_1_std
      value: -20.159842923954475
    - type: nauc_map_at_20_diff1
      value: 50.026410103063576
    - type: nauc_map_at_20_max
      value: 29.770173596928444
    - type: nauc_map_at_20_std
      value: -19.398108689295622
    - type: nauc_map_at_3_diff1
      value: 50.12369021949809
    - type: nauc_map_at_3_max
      value: 27.918094022890692
    - type: nauc_map_at_3_std
      value: -20.816408880461136
    - type: nauc_map_at_5_diff1
      value: 49.88266421157269
    - type: nauc_map_at_5_max
      value: 28.803327575103616
    - type: nauc_map_at_5_std
      value: -20.412325693429622
    - type: nauc_mrr_at_1000_diff1
      value: 50.08675690045023
    - type: nauc_mrr_at_1000_max
      value: 33.51316969904977
    - type: nauc_mrr_at_1000_std
      value: -16.325548962557693
    - type: nauc_mrr_at_100_diff1
      value: 50.084570223694804
    - type: nauc_mrr_at_100_max
      value: 33.53170304618603
    - type: nauc_mrr_at_100_std
      value: -16.315669293904236
    - type: nauc_mrr_at_10_diff1
      value: 50.104359262926614
    - type: nauc_mrr_at_10_max
      value: 33.454171357296374
    - type: nauc_mrr_at_10_std
      value: -16.672238640691564
    - type: nauc_mrr_at_1_diff1
      value: 54.46283195658263
    - type: nauc_mrr_at_1_max
      value: 33.5006771800345
    - type: nauc_mrr_at_1_std
      value: -15.72197238923995
    - type: nauc_mrr_at_20_diff1
      value: 50.04428019672954
    - type: nauc_mrr_at_20_max
      value: 33.43915921871757
    - type: nauc_mrr_at_20_std
      value: -16.47775099091468
    - type: nauc_mrr_at_3_diff1
      value: 49.29563277160461
    - type: nauc_mrr_at_3_max
      value: 32.609171651470724
    - type: nauc_mrr_at_3_std
      value: -16.8176459078524
    - type: nauc_mrr_at_5_diff1
      value: 49.59993245767094
    - type: nauc_mrr_at_5_max
      value: 33.145357294405365
    - type: nauc_mrr_at_5_std
      value: -16.886783105921864
    - type: nauc_ndcg_at_1000_diff1
      value: 49.84200528661306
    - type: nauc_ndcg_at_1000_max
      value: 32.7463038531318
    - type: nauc_ndcg_at_1000_std
      value: -16.229179922128097
    - type: nauc_ndcg_at_100_diff1
      value: 49.78798184218895
    - type: nauc_ndcg_at_100_max
      value: 33.19106180162596
    - type: nauc_ndcg_at_100_std
      value: -15.964597177057572
    - type: nauc_ndcg_at_10_diff1
      value: 49.10239998219158
    - type: nauc_ndcg_at_10_max
      value: 31.18073711193898
    - type: nauc_ndcg_at_10_std
      value: -19.103888016157107
    - type: nauc_ndcg_at_1_diff1
      value: 54.46283195658263
    - type: nauc_ndcg_at_1_max
      value: 33.5006771800345
    - type: nauc_ndcg_at_1_std
      value: -15.72197238923995
    - type: nauc_ndcg_at_20_diff1
      value: 49.12986473579085
    - type: nauc_ndcg_at_20_max
      value: 31.555721190821874
    - type: nauc_ndcg_at_20_std
      value: -18.03991726456339
    - type: nauc_ndcg_at_3_diff1
      value: 48.06266636428524
    - type: nauc_ndcg_at_3_max
      value: 29.800215619456498
    - type: nauc_ndcg_at_3_std
      value: -19.534322783334527
    - type: nauc_ndcg_at_5_diff1
      value: 48.15095160139167
    - type: nauc_ndcg_at_5_max
      value: 30.208802143718682
    - type: nauc_ndcg_at_5_std
      value: -19.9192266388754
    - type: nauc_precision_at_1000_diff1
      value: -14.22147314326395
    - type: nauc_precision_at_1000_max
      value: 4.578027927831382
    - type: nauc_precision_at_1000_std
      value: 17.42650517281872
    - type: nauc_precision_at_100_diff1
      value: -6.889359682595786
    - type: nauc_precision_at_100_max
      value: 13.816120144295166
    - type: nauc_precision_at_100_std
      value: 19.169326264844834
    - type: nauc_precision_at_10_diff1
      value: 11.630213989568256
    - type: nauc_precision_at_10_max
      value: 25.18561447388641
    - type: nauc_precision_at_10_std
      value: 3.5091485378988714
    - type: nauc_precision_at_1_diff1
      value: 54.46283195658263
    - type: nauc_precision_at_1_max
      value: 33.5006771800345
    - type: nauc_precision_at_1_std
      value: -15.72197238923995
    - type: nauc_precision_at_20_diff1
      value: 3.5727333022082184
    - type: nauc_precision_at_20_max
      value: 20.959966668076714
    - type: nauc_precision_at_20_std
      value: 11.024682685903581
    - type: nauc_precision_at_3_diff1
      value: 27.22306777334495
    - type: nauc_precision_at_3_max
      value: 30.39888856674192
    - type: nauc_precision_at_3_std
      value: -7.583643149291899
    - type: nauc_precision_at_5_diff1
      value: 18.788243224115185
    - type: nauc_precision_at_5_max
      value: 28.14592563430115
    - type: nauc_precision_at_5_std
      value: -3.10270506824694
    - type: nauc_recall_at_1000_diff1
      value: 62.4411056243426
    - type: nauc_recall_at_1000_max
      value: 69.22941585002123
    - type: nauc_recall_at_1000_std
      value: 36.11911276552335
    - type: nauc_recall_at_100_diff1
      value: 44.59026422323201
    - type: nauc_recall_at_100_max
      value: 47.97129128154523
    - type: nauc_recall_at_100_std
      value: 4.778892937753897
    - type: nauc_recall_at_10_diff1
      value: 43.25042694366798
    - type: nauc_recall_at_10_max
      value: 30.67002821157203
    - type: nauc_recall_at_10_std
      value: -18.821325601418703
    - type: nauc_recall_at_1_diff1
      value: 56.10337790434511
    - type: nauc_recall_at_1_max
      value: 26.249897485765477
    - type: nauc_recall_at_1_std
      value: -20.159842923954475
    - type: nauc_recall_at_20_diff1
      value: 41.53741723146757
    - type: nauc_recall_at_20_max
      value: 30.852977167860324
    - type: nauc_recall_at_20_std
      value: -14.824694384045237
    - type: nauc_recall_at_3_diff1
      value: 42.251002622079916
    - type: nauc_recall_at_3_max
      value: 25.083846761725724
    - type: nauc_recall_at_3_std
      value: -22.239786875574765
    - type: nauc_recall_at_5_diff1
      value: 41.146094656121385
    - type: nauc_recall_at_5_max
      value: 27.189625490714608
    - type: nauc_recall_at_5_std
      value: -22.001469364479068
    - type: ndcg_at_1
      value: 41.482
    - type: ndcg_at_10
      value: 54.004
    - type: ndcg_at_100
      value: 59.455000000000005
    - type: ndcg_at_1000
      value: 60.831999999999994
    - type: ndcg_at_20
      value: 56.484
    - type: ndcg_at_3
      value: 48.802
    - type: ndcg_at_5
      value: 51.43600000000001
    - type: precision_at_1
      value: 41.482
    - type: precision_at_10
      value: 9.99
    - type: precision_at_100
      value: 1.4989999999999999
    - type: precision_at_1000
      value: 0.178
    - type: precision_at_20
      value: 5.861000000000001
    - type: precision_at_3
      value: 23.709
    - type: precision_at_5
      value: 16.843
    - type: recall_at_1
      value: 33.586
    - type: recall_at_10
      value: 67.754
    - type: recall_at_100
      value: 89.689
    - type: recall_at_1000
      value: 98.212
    - type: recall_at_20
      value: 76.253
    - type: recall_at_3
      value: 53.181
    - type: recall_at_5
      value: 60.122
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackProgrammersRetrieval
      type: mteb/cqadupstack-programmers
      config: default
      split: test
      revision: 6184bc1440d2dbc7612be22b50686b8826d22b32
    metrics:
    - type: main_score
      value: 50.547
    - type: map_at_1
      value: 30.547
    - type: map_at_10
      value: 43.595
    - type: map_at_100
      value: 45.044000000000004
    - type: map_at_1000
      value: 45.143
    - type: map_at_20
      value: 44.46
    - type: map_at_3
      value: 39.512
    - type: map_at_5
      value: 41.655
    - type: mrr_at_1
      value: 38.242009132420094
    - type: mrr_at_10
      value: 49.150811770674785
    - type: mrr_at_100
      value: 49.95736920255132
    - type: mrr_at_1000
      value: 49.991323278325005
    - type: mrr_at_20
      value: 49.64605069442795
    - type: mrr_at_3
      value: 46.19482496194824
    - type: mrr_at_5
      value: 47.74162861491625
    - type: nauc_map_at_1000_diff1
      value: 40.52349853300547
    - type: nauc_map_at_1000_max
      value: 31.561296386270925
    - type: nauc_map_at_1000_std
      value: -5.03343890785704
    - type: nauc_map_at_100_diff1
      value: 40.48825194476996
    - type: nauc_map_at_100_max
      value: 31.553405159588717
    - type: nauc_map_at_100_std
      value: -5.042866610979561
    - type: nauc_map_at_10_diff1
      value: 40.39926831942659
    - type: nauc_map_at_10_max
      value: 30.946628618728266
    - type: nauc_map_at_10_std
      value: -5.776518335664868
    - type: nauc_map_at_1_diff1
      value: 44.73341103510332
    - type: nauc_map_at_1_max
      value: 24.72510025576844
    - type: nauc_map_at_1_std
      value: -11.010252578512175
    - type: nauc_map_at_20_diff1
      value: 40.44256461277349
    - type: nauc_map_at_20_max
      value: 31.466590802666467
    - type: nauc_map_at_20_std
      value: -5.113421418562381
    - type: nauc_map_at_3_diff1
      value: 41.38809172163691
    - type: nauc_map_at_3_max
      value: 29.48868065104881
    - type: nauc_map_at_3_std
      value: -8.459559994349043
    - type: nauc_map_at_5_diff1
      value: 40.50417748715188
    - type: nauc_map_at_5_max
      value: 30.375034537551333
    - type: nauc_map_at_5_std
      value: -6.829586305389068
    - type: nauc_mrr_at_1000_diff1
      value: 38.13147562273569
    - type: nauc_mrr_at_1000_max
      value: 33.4729877260649
    - type: nauc_mrr_at_1000_std
      value: -2.115383391956632
    - type: nauc_mrr_at_100_diff1
      value: 38.12352986074086
    - type: nauc_mrr_at_100_max
      value: 33.47904382055151
    - type: nauc_mrr_at_100_std
      value: -2.0980380463248816
    - type: nauc_mrr_at_10_diff1
      value: 37.879793238833486
    - type: nauc_mrr_at_10_max
      value: 33.24190962300982
    - type: nauc_mrr_at_10_std
      value: -2.197979308633544
    - type: nauc_mrr_at_1_diff1
      value: 40.89812140583222
    - type: nauc_mrr_at_1_max
      value: 30.547640253413395
    - type: nauc_mrr_at_1_std
      value: -4.319528874623733
    - type: nauc_mrr_at_20_diff1
      value: 38.08114567265545
    - type: nauc_mrr_at_20_max
      value: 33.5751626334935
    - type: nauc_mrr_at_20_std
      value: -2.0190711781853805
    - type: nauc_mrr_at_3_diff1
      value: 38.36593445752741
    - type: nauc_mrr_at_3_max
      value: 33.5606672994442
    - type: nauc_mrr_at_3_std
      value: -3.313496883242172
    - type: nauc_mrr_at_5_diff1
      value: 37.67325286264018
    - type: nauc_mrr_at_5_max
      value: 33.36028645933453
    - type: nauc_mrr_at_5_std
      value: -2.5553616249884756
    - type: nauc_ndcg_at_1000_diff1
      value: 39.15178707833506
    - type: nauc_ndcg_at_1000_max
      value: 33.25615613608456
    - type: nauc_ndcg_at_1000_std
      value: -2.1792655266044645
    - type: nauc_ndcg_at_100_diff1
      value: 38.9781153280577
    - type: nauc_ndcg_at_100_max
      value: 33.59332040478102
    - type: nauc_ndcg_at_100_std
      value: -1.6261785471415764
    - type: nauc_ndcg_at_10_diff1
      value: 38.497420832277975
    - type: nauc_ndcg_at_10_max
      value: 32.53253337236221
    - type: nauc_ndcg_at_10_std
      value: -2.997611061467513
    - type: nauc_ndcg_at_1_diff1
      value: 40.89812140583222
    - type: nauc_ndcg_at_1_max
      value: 30.547640253413395
    - type: nauc_ndcg_at_1_std
      value: -4.319528874623733
    - type: nauc_ndcg_at_20_diff1
      value: 38.81727541423619
    - type: nauc_ndcg_at_20_max
      value: 33.83499432459841
    - type: nauc_ndcg_at_20_std
      value: -1.4541145324463343
    - type: nauc_ndcg_at_3_diff1
      value: 39.21372121259748
    - type: nauc_ndcg_at_3_max
      value: 32.21240027184339
    - type: nauc_ndcg_at_3_std
      value: -5.818515242107007
    - type: nauc_ndcg_at_5_diff1
      value: 38.36581068852509
    - type: nauc_ndcg_at_5_max
      value: 32.31265492516815
    - type: nauc_ndcg_at_5_std
      value: -4.347865800300811
    - type: nauc_precision_at_1000_diff1
      value: -2.9404408066555487
    - type: nauc_precision_at_1000_max
      value: 11.959727087923113
    - type: nauc_precision_at_1000_std
      value: 19.807537724237182
    - type: nauc_precision_at_100_diff1
      value: -1.8903473485508044
    - type: nauc_precision_at_100_max
      value: 17.859451192772262
    - type: nauc_precision_at_100_std
      value: 20.978283478932195
    - type: nauc_precision_at_10_diff1
      value: 7.827166236013994
    - type: nauc_precision_at_10_max
      value: 27.639518058609987
    - type: nauc_precision_at_10_std
      value: 16.2656199079196
    - type: nauc_precision_at_1_diff1
      value: 40.89812140583222
    - type: nauc_precision_at_1_max
      value: 30.547640253413395
    - type: nauc_precision_at_1_std
      value: -4.319528874623733
    - type: nauc_precision_at_20_diff1
      value: 3.0739728724420488
    - type: nauc_precision_at_20_max
      value: 24.28491071974094
    - type: nauc_precision_at_20_std
      value: 19.64404584038665
    - type: nauc_precision_at_3_diff1
      value: 23.38851433425848
    - type: nauc_precision_at_3_max
      value: 34.046714722976056
    - type: nauc_precision_at_3_std
      value: 4.085453450220984
    - type: nauc_precision_at_5_diff1
      value: 14.827066677039587
    - type: nauc_precision_at_5_max
      value: 31.844657859314747
    - type: nauc_precision_at_5_std
      value: 11.233146291519418
    - type: nauc_recall_at_1000_diff1
      value: 40.585961683508714
    - type: nauc_recall_at_1000_max
      value: 48.857695287563935
    - type: nauc_recall_at_1000_std
      value: 43.20362271394189
    - type: nauc_recall_at_100_diff1
      value: 32.24127663397077
    - type: nauc_recall_at_100_max
      value: 38.836350075837004
    - type: nauc_recall_at_100_std
      value: 17.622027048501153
    - type: nauc_recall_at_10_diff1
      value: 31.30410560798441
    - type: nauc_recall_at_10_max
      value: 30.93697991799787
    - type: nauc_recall_at_10_std
      value: 1.5177200901024983
    - type: nauc_recall_at_1_diff1
      value: 44.73341103510332
    - type: nauc_recall_at_1_max
      value: 24.72510025576844
    - type: nauc_recall_at_1_std
      value: -11.010252578512175
    - type: nauc_recall_at_20_diff1
      value: 31.93561881507333
    - type: nauc_recall_at_20_max
      value: 36.879629985707076
    - type: nauc_recall_at_20_std
      value: 9.68448188578646
    - type: nauc_recall_at_3_diff1
      value: 36.243457137883894
    - type: nauc_recall_at_3_max
      value: 30.46545172710201
    - type: nauc_recall_at_3_std
      value: -7.391349871928162
    - type: nauc_recall_at_5_diff1
      value: 32.999190531912554
    - type: nauc_recall_at_5_max
      value: 30.87264732206836
    - type: nauc_recall_at_5_std
      value: -3.3937930443165434
    - type: ndcg_at_1
      value: 38.242
    - type: ndcg_at_10
      value: 50.547
    - type: ndcg_at_100
      value: 55.994
    - type: ndcg_at_1000
      value: 57.538
    - type: ndcg_at_20
      value: 52.954
    - type: ndcg_at_3
      value: 44.283
    - type: ndcg_at_5
      value: 46.86
    - type: precision_at_1
      value: 38.242
    - type: precision_at_10
      value: 9.498
    - type: precision_at_100
      value: 1.424
    - type: precision_at_1000
      value: 0.174
    - type: precision_at_20
      value: 5.628
    - type: precision_at_3
      value: 21.271
    - type: precision_at_5
      value: 15.342
    - type: recall_at_1
      value: 30.547
    - type: recall_at_10
      value: 65.42999999999999
    - type: recall_at_100
      value: 87.92
    - type: recall_at_1000
      value: 97.68599999999999
    - type: recall_at_20
      value: 73.685
    - type: recall_at_3
      value: 47.979
    - type: recall_at_5
      value: 54.69199999999999
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackStatsRetrieval
      type: mteb/cqadupstack-stats
      config: default
      split: test
      revision: 65ac3a16b8e91f9cee4c9828cc7c335575432a2a
    metrics:
    - type: main_score
      value: 42.379
    - type: map_at_1
      value: 28.076
    - type: map_at_10
      value: 37.187
    - type: map_at_100
      value: 38.163000000000004
    - type: map_at_1000
      value: 38.262
    - type: map_at_20
      value: 37.649
    - type: map_at_3
      value: 34.361000000000004
    - type: map_at_5
      value: 36.024
    - type: mrr_at_1
      value: 31.13496932515337
    - type: mrr_at_10
      value: 39.87084915765898
    - type: mrr_at_100
      value: 40.63847645369495
    - type: mrr_at_1000
      value: 40.70451576754048
    - type: mrr_at_20
      value: 40.25268368368429
    - type: mrr_at_3
      value: 37.37218813905932
    - type: mrr_at_5
      value: 38.698875255623726
    - type: nauc_map_at_1000_diff1
      value: 53.23968282874812
    - type: nauc_map_at_1000_max
      value: 33.785923443457136
    - type: nauc_map_at_1000_std
      value: -7.1706965835194145
    - type: nauc_map_at_100_diff1
      value: 53.23488336800868
    - type: nauc_map_at_100_max
      value: 33.78610121008569
    - type: nauc_map_at_100_std
      value: -7.15094162130079
    - type: nauc_map_at_10_diff1
      value: 53.52788129491361
    - type: nauc_map_at_10_max
      value: 33.55616013388991
    - type: nauc_map_at_10_std
      value: -7.6857282749978
    - type: nauc_map_at_1_diff1
      value: 59.34174527256049
    - type: nauc_map_at_1_max
      value: 32.58063146059831
    - type: nauc_map_at_1_std
      value: -9.540287370085819
    - type: nauc_map_at_20_diff1
      value: 53.16586961282429
    - type: nauc_map_at_20_max
      value: 33.69272685105737
    - type: nauc_map_at_20_std
      value: -7.380323341082431
    - type: nauc_map_at_3_diff1
      value: 55.28137765707177
    - type: nauc_map_at_3_max
      value: 33.45378492437827
    - type: nauc_map_at_3_std
      value: -8.18647355512435
    - type: nauc_map_at_5_diff1
      value: 53.8836295908436
    - type: nauc_map_at_5_max
      value: 33.822344952119785
    - type: nauc_map_at_5_std
      value: -7.64537861608003
    - type: nauc_mrr_at_1000_diff1
      value: 51.841157711545215
    - type: nauc_mrr_at_1000_max
      value: 34.9249740423282
    - type: nauc_mrr_at_1000_std
      value: -5.797330608658271
    - type: nauc_mrr_at_100_diff1
      value: 51.82520112610312
    - type: nauc_mrr_at_100_max
      value: 34.9362444083548
    - type: nauc_mrr_at_100_std
      value: -5.7681632136177585
    - type: nauc_mrr_at_10_diff1
      value: 51.81624637385308
    - type: nauc_mrr_at_10_max
      value: 34.837632307043705
    - type: nauc_mrr_at_10_std
      value: -6.09995049270317
    - type: nauc_mrr_at_1_diff1
      value: 58.37854579448285
    - type: nauc_mrr_at_1_max
      value: 34.672901734986844
    - type: nauc_mrr_at_1_std
      value: -7.066787533024501
    - type: nauc_mrr_at_20_diff1
      value: 51.65185881732499
    - type: nauc_mrr_at_20_max
      value: 34.925636736880925
    - type: nauc_mrr_at_20_std
      value: -5.827364722186311
    - type: nauc_mrr_at_3_diff1
      value: 53.51689033144754
    - type: nauc_mrr_at_3_max
      value: 34.75062118986762
    - type: nauc_mrr_at_3_std
      value: -6.580474412596013
    - type: nauc_mrr_at_5_diff1
      value: 52.291499624036355
    - type: nauc_mrr_at_5_max
      value: 35.066619088016196
    - type: nauc_mrr_at_5_std
      value: -6.1986345561829195
    - type: nauc_ndcg_at_1000_diff1
      value: 50.51376093038994
    - type: nauc_ndcg_at_1000_max
      value: 34.725822070535685
    - type: nauc_ndcg_at_1000_std
      value: -4.434746308735319
    - type: nauc_ndcg_at_100_diff1
      value: 49.81860985607077
    - type: nauc_ndcg_at_100_max
      value: 34.692760290424815
    - type: nauc_ndcg_at_100_std
      value: -3.835522029514012
    - type: nauc_ndcg_at_10_diff1
      value: 50.3513048763106
    - type: nauc_ndcg_at_10_max
      value: 33.72184194935727
    - type: nauc_ndcg_at_10_std
      value: -6.798983244879382
    - type: nauc_ndcg_at_1_diff1
      value: 58.37854579448285
    - type: nauc_ndcg_at_1_max
      value: 34.672901734986844
    - type: nauc_ndcg_at_1_std
      value: -7.066787533024501
    - type: nauc_ndcg_at_20_diff1
      value: 49.29162167829859
    - type: nauc_ndcg_at_20_max
      value: 34.16877295196376
    - type: nauc_ndcg_at_20_std
      value: -5.597014358860604
    - type: nauc_ndcg_at_3_diff1
      value: 53.10834468009104
    - type: nauc_ndcg_at_3_max
      value: 34.33773588752504
    - type: nauc_ndcg_at_3_std
      value: -7.243624483216034
    - type: nauc_ndcg_at_5_diff1
      value: 51.104845457630354
    - type: nauc_ndcg_at_5_max
      value: 34.38674960727082
    - type: nauc_ndcg_at_5_std
      value: -6.949153425119295
    - type: nauc_precision_at_1000_diff1
      value: -9.296436979607215
    - type: nauc_precision_at_1000_max
      value: 6.4385608601441255
    - type: nauc_precision_at_1000_std
      value: 9.323328514309525
    - type: nauc_precision_at_100_diff1
      value: 1.6478610402380616
    - type: nauc_precision_at_100_max
      value: 18.351794901313585
    - type: nauc_precision_at_100_std
      value: 14.665874744283974
    - type: nauc_precision_at_10_diff1
      value: 25.534183841642637
    - type: nauc_precision_at_10_max
      value: 29.40076026042332
    - type: nauc_precision_at_10_std
      value: 2.9872193044238453
    - type: nauc_precision_at_1_diff1
      value: 58.37854579448285
    - type: nauc_precision_at_1_max
      value: 34.672901734986844
    - type: nauc_precision_at_1_std
      value: -7.066787533024501
    - type: nauc_precision_at_20_diff1
      value: 15.647544367678556
    - type: nauc_precision_at_20_max
      value: 27.05732589353733
    - type: nauc_precision_at_20_std
      value: 7.191923029484484
    - type: nauc_precision_at_3_diff1
      value: 43.617914587502476
    - type: nauc_precision_at_3_max
      value: 34.43947964259185
    - type: nauc_precision_at_3_std
      value: -2.2997019515698853
    - type: nauc_precision_at_5_diff1
      value: 33.45902372451529
    - type: nauc_precision_at_5_max
      value: 33.345179920600174
    - type: nauc_precision_at_5_std
      value: 0.6402432222388739
    - type: nauc_recall_at_1000_diff1
      value: 29.85614248165102
    - type: nauc_recall_at_1000_max
      value: 43.12189214089366
    - type: nauc_recall_at_1000_std
      value: 38.028489124610644
    - type: nauc_recall_at_100_diff1
      value: 33.1910221741884
    - type: nauc_recall_at_100_max
      value: 36.878036476663056
    - type: nauc_recall_at_100_std
      value: 17.505589309024437
    - type: nauc_recall_at_10_diff1
      value: 40.89508005321193
    - type: nauc_recall_at_10_max
      value: 31.718075561656622
    - type: nauc_recall_at_10_std
      value: -5.5201680473345105
    - type: nauc_recall_at_1_diff1
      value: 59.34174527256049
    - type: nauc_recall_at_1_max
      value: 32.58063146059831
    - type: nauc_recall_at_1_std
      value: -9.540287370085819
    - type: nauc_recall_at_20_diff1
      value: 35.66013790544511
    - type: nauc_recall_at_20_max
      value: 32.86639975082532
    - type: nauc_recall_at_20_std
      value: -0.7884329140983038
    - type: nauc_recall_at_3_diff1
      value: 49.19221784465332
    - type: nauc_recall_at_3_max
      value: 33.023935837910756
    - type: nauc_recall_at_3_std
      value: -7.019711964409782
    - type: nauc_recall_at_5_diff1
      value: 44.67980008380877
    - type: nauc_recall_at_5_max
      value: 33.64495915667608
    - type: nauc_recall_at_5_std
      value: -6.146102608248518
    - type: ndcg_at_1
      value: 31.135
    - type: ndcg_at_10
      value: 42.379
    - type: ndcg_at_100
      value: 47.296
    - type: ndcg_at_1000
      value: 49.403999999999996
    - type: ndcg_at_20
      value: 43.93
    - type: ndcg_at_3
      value: 37.196
    - type: ndcg_at_5
      value: 39.75
    - type: precision_at_1
      value: 31.135
    - type: precision_at_10
      value: 6.81
    - type: precision_at_100
      value: 1.014
    - type: precision_at_1000
      value: 0.127
    - type: precision_at_20
      value: 3.834
    - type: precision_at_3
      value: 16.002
    - type: precision_at_5
      value: 11.411
    - type: recall_at_1
      value: 28.076
    - type: recall_at_10
      value: 55.509
    - type: recall_at_100
      value: 78.396
    - type: recall_at_1000
      value: 93.124
    - type: recall_at_20
      value: 61.326
    - type: recall_at_3
      value: 41.399
    - type: recall_at_5
      value: 47.567
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackTexRetrieval
      type: mteb/cqadupstack-tex
      config: default
      split: test
      revision: 46989137a86843e03a6195de44b09deda022eec7
    metrics:
    - type: main_score
      value: 37.114999999999995
    - type: map_at_1
      value: 22.032
    - type: map_at_10
      value: 31.392999999999997
    - type: map_at_100
      value: 32.681
    - type: map_at_1000
      value: 32.803
    - type: map_at_20
      value: 32.092999999999996
    - type: map_at_3
      value: 28.33
    - type: map_at_5
      value: 29.988999999999997
    - type: mrr_at_1
      value: 26.944253269098418
    - type: mrr_at_10
      value: 35.76442827647241
    - type: mrr_at_100
      value: 36.70928542668393
    - type: mrr_at_1000
      value: 36.770222872867485
    - type: mrr_at_20
      value: 36.28598608599559
    - type: mrr_at_3
      value: 33.167010782289594
    - type: mrr_at_5
      value: 34.620899288827864
    - type: nauc_map_at_1000_diff1
      value: 38.09265419483922
    - type: nauc_map_at_1000_max
      value: 25.105090914997024
    - type: nauc_map_at_1000_std
      value: 1.0700959987729692
    - type: nauc_map_at_100_diff1
      value: 38.063239842931246
    - type: nauc_map_at_100_max
      value: 25.071823053158475
    - type: nauc_map_at_100_std
      value: 1.0427996382419578
    - type: nauc_map_at_10_diff1
      value: 38.063314345359736
    - type: nauc_map_at_10_max
      value: 24.90358356796509
    - type: nauc_map_at_10_std
      value: 0.48891415762356544
    - type: nauc_map_at_1_diff1
      value: 44.192488964031135
    - type: nauc_map_at_1_max
      value: 23.101395238489264
    - type: nauc_map_at_1_std
      value: -0.44274744959708606
    - type: nauc_map_at_20_diff1
      value: 38.02737709746376
    - type: nauc_map_at_20_max
      value: 25.015577711149145
    - type: nauc_map_at_20_std
      value: 0.7752620565795433
    - type: nauc_map_at_3_diff1
      value: 38.79059906518923
    - type: nauc_map_at_3_max
      value: 24.278973778653658
    - type: nauc_map_at_3_std
      value: -0.06600853085223404
    - type: nauc_map_at_5_diff1
      value: 38.38811885476713
    - type: nauc_map_at_5_max
      value: 24.906014694358767
    - type: nauc_map_at_5_std
      value: 0.503696622267735
    - type: nauc_mrr_at_1000_diff1
      value: 38.43851052537515
    - type: nauc_mrr_at_1000_max
      value: 26.08088413681578
    - type: nauc_mrr_at_1000_std
      value: 2.260435008633633
    - type: nauc_mrr_at_100_diff1
      value: 38.42446503025336
    - type: nauc_mrr_at_100_max
      value: 26.06653535777771
    - type: nauc_mrr_at_100_std
      value: 2.2508085472342567
    - type: nauc_mrr_at_10_diff1
      value: 38.42491058346722
    - type: nauc_mrr_at_10_max
      value: 26.046875548569524
    - type: nauc_mrr_at_10_std
      value: 1.991934209812353
    - type: nauc_mrr_at_1_diff1
      value: 44.125116470111806
    - type: nauc_mrr_at_1_max
      value: 25.502414026989822
    - type: nauc_mrr_at_1_std
      value: 1.0717390948764505
    - type: nauc_mrr_at_20_diff1
      value: 38.355654581557275
    - type: nauc_mrr_at_20_max
      value: 26.052337555999888
    - type: nauc_mrr_at_20_std
      value: 2.0892219127514107
    - type: nauc_mrr_at_3_diff1
      value: 39.001757864272676
    - type: nauc_mrr_at_3_max
      value: 25.98003648378764
    - type: nauc_mrr_at_3_std
      value: 1.6394764040482228
    - type: nauc_mrr_at_5_diff1
      value: 38.71163053840094
    - type: nauc_mrr_at_5_max
      value: 26.20780413201001
    - type: nauc_mrr_at_5_std
      value: 2.021661434346652
    - type: nauc_ndcg_at_1000_diff1
      value: 36.31450458217211
    - type: nauc_ndcg_at_1000_max
      value: 26.149308380875073
    - type: nauc_ndcg_at_1000_std
      value: 3.905862488970823
    - type: nauc_ndcg_at_100_diff1
      value: 35.963790362714164
    - type: nauc_ndcg_at_100_max
      value: 25.739750793393007
    - type: nauc_ndcg_at_100_std
      value: 3.7112777105604406
    - type: nauc_ndcg_at_10_diff1
      value: 35.99336074029864
    - type: nauc_ndcg_at_10_max
      value: 25.55200053240736
    - type: nauc_ndcg_at_10_std
      value: 1.5588036488952475
    - type: nauc_ndcg_at_1_diff1
      value: 44.125116470111806
    - type: nauc_ndcg_at_1_max
      value: 25.502414026989822
    - type: nauc_ndcg_at_1_std
      value: 1.0717390948764505
    - type: nauc_ndcg_at_20_diff1
      value: 35.73590736885051
    - type: nauc_ndcg_at_20_max
      value: 25.70046947040548
    - type: nauc_ndcg_at_20_std
      value: 2.271321757997752
    - type: nauc_ndcg_at_3_diff1
      value: 37.32573641209906
    - type: nauc_ndcg_at_3_max
      value: 25.1167909777267
    - type: nauc_ndcg_at_3_std
      value: 0.7212992566129185
    - type: nauc_ndcg_at_5_diff1
      value: 36.712049675888636
    - type: nauc_ndcg_at_5_max
      value: 25.792607516706372
    - type: nauc_ndcg_at_5_std
      value: 1.578770099119
    - type: nauc_precision_at_1000_diff1
      value: 3.6736780338116977
    - type: nauc_precision_at_1000_max
      value: 11.81314408533315
    - type: nauc_precision_at_1000_std
      value: 10.2436841196851
    - type: nauc_precision_at_100_diff1
      value: 8.417413354516071
    - type: nauc_precision_at_100_max
      value: 16.205114523661024
    - type: nauc_precision_at_100_std
      value: 13.594635835595328
    - type: nauc_precision_at_10_diff1
      value: 19.048008342402845
    - type: nauc_precision_at_10_max
      value: 23.350651852456103
    - type: nauc_precision_at_10_std
      value: 5.976335419523274
    - type: nauc_precision_at_1_diff1
      value: 44.125116470111806
    - type: nauc_precision_at_1_max
      value: 25.502414026989822
    - type: nauc_precision_at_1_std
      value: 1.0717390948764505
    - type: nauc_precision_at_20_diff1
      value: 15.474925061953678
    - type: nauc_precision_at_20_max
      value: 21.546991193902272
    - type: nauc_precision_at_20_std
      value: 8.905930860583391
    - type: nauc_precision_at_3_diff1
      value: 28.986321566644303
    - type: nauc_precision_at_3_max
      value: 26.69485123311458
    - type: nauc_precision_at_3_std
      value: 3.4263045093511537
    - type: nauc_precision_at_5_diff1
      value: 24.709408636594915
    - type: nauc_precision_at_5_max
      value: 26.67143866400471
    - type: nauc_precision_at_5_std
      value: 5.19041364886639
    - type: nauc_recall_at_1000_diff1
      value: 20.00674566428088
    - type: nauc_recall_at_1000_max
      value: 34.777585777551536
    - type: nauc_recall_at_1000_std
      value: 36.77107209206558
    - type: nauc_recall_at_100_diff1
      value: 24.285256665242304
    - type: nauc_recall_at_100_max
      value: 23.801866644708262
    - type: nauc_recall_at_100_std
      value: 15.064509694858854
    - type: nauc_recall_at_10_diff1
      value: 27.36808052999267
    - type: nauc_recall_at_10_max
      value: 24.053807252852636
    - type: nauc_recall_at_10_std
      value: 2.597884142562802
    - type: nauc_recall_at_1_diff1
      value: 44.192488964031135
    - type: nauc_recall_at_1_max
      value: 23.101395238489264
    - type: nauc_recall_at_1_std
      value: -0.44274744959708606
    - type: nauc_recall_at_20_diff1
      value: 25.65995095802745
    - type: nauc_recall_at_20_max
      value: 24.31913892777212
    - type: nauc_recall_at_20_std
      value: 5.048151975361747
    - type: nauc_recall_at_3_diff1
      value: 32.07015707209654
    - type: nauc_recall_at_3_max
      value: 23.698394784703815
    - type: nauc_recall_at_3_std
      value: 0.4539034711477527
    - type: nauc_recall_at_5_diff1
      value: 30.186485460653582
    - type: nauc_recall_at_5_max
      value: 25.00467869253249
    - type: nauc_recall_at_5_std
      value: 2.598872826683705
    - type: ndcg_at_1
      value: 26.944000000000003
    - type: ndcg_at_10
      value: 37.114999999999995
    - type: ndcg_at_100
      value: 42.846000000000004
    - type: ndcg_at_1000
      value: 45.228
    - type: ndcg_at_20
      value: 39.26
    - type: ndcg_at_3
      value: 31.891000000000002
    - type: ndcg_at_5
      value: 34.261
    - type: precision_at_1
      value: 26.944000000000003
    - type: precision_at_10
      value: 6.8790000000000004
    - type: precision_at_100
      value: 1.138
    - type: precision_at_1000
      value: 0.154
    - type: precision_at_20
      value: 4.092
    - type: precision_at_3
      value: 15.244
    - type: precision_at_5
      value: 11.004999999999999
    - type: recall_at_1
      value: 22.032
    - type: recall_at_10
      value: 49.830999999999996
    - type: recall_at_100
      value: 75.318
    - type: recall_at_1000
      value: 91.526
    - type: recall_at_20
      value: 57.684999999999995
    - type: recall_at_3
      value: 35.144999999999996
    - type: recall_at_5
      value: 41.377
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackRetrieval
      type: mteb/cqadupstack
      config: default
      split: test
    metrics:
    - type: main_score
      value: 49.35933333333333
    - type: map_at_1
      value: 31.5475
    - type: map_at_10
      value: 43.166916666666665
    - type: map_at_100
      value: 44.506083333333336
    - type: map_at_1000
      value: 44.60875
    - type: map_at_20
      value: 43.926166666666674
    - type: map_at_3
      value: 39.7375
    - type: map_at_5
      value: 41.63241666666667
    - type: mrr_at_1
      value: 37.58487329336356
    - type: mrr_at_10
      value: 47.57339949857069
    - type: mrr_at_100
      value: 48.37962696919692
    - type: mrr_at_1000
      value: 48.42044074093141
    - type: mrr_at_20
      value: 48.05694412330748
    - type: mrr_at_3
      value: 45.01312222327854
    - type: mrr_at_5
      value: 46.45963570299018
    - type: nauc_map_at_1000_diff1
      value: 47.559431895551796
    - type: nauc_map_at_1000_max
      value: 32.22624317021025
    - type: nauc_map_at_1000_std
      value: -9.215659016819911
    - type: nauc_map_at_100_diff1
      value: 47.5522725421024
    - type: nauc_map_at_100_max
      value: 32.23227770404454
    - type: nauc_map_at_100_std
      value: -9.257263949623699
    - type: nauc_map_at_10_diff1
      value: 47.62525599466672
    - type: nauc_map_at_10_max
      value: 31.810691404066432
    - type: nauc_map_at_10_std
      value: -10.159455545932724
    - type: nauc_map_at_1_diff1
      value: 52.959829481566764
    - type: nauc_map_at_1_max
      value: 28.644143760250785
    - type: nauc_map_at_1_std
      value: -11.72163597077123
    - type: nauc_map_at_20_diff1
      value: 47.56050095649268
    - type: nauc_map_at_20_max
      value: 32.08395945370071
    - type: nauc_map_at_20_std
      value: -9.628010776060316
    - type: nauc_map_at_3_diff1
      value: 48.51453660580493
    - type: nauc_map_at_3_max
      value: 30.898488535624786
    - type: nauc_map_at_3_std
      value: -11.15241799050688
    - type: nauc_map_at_5_diff1
      value: 47.85361615288319
    - type: nauc_map_at_5_max
      value: 31.396160977070693
    - type: nauc_map_at_5_std
      value: -10.669927060581687
    - type: nauc_mrr_at_1000_diff1
      value: 46.5756551519747
    - type: nauc_mrr_at_1000_max
      value: 33.613205491060505
    - type: nauc_mrr_at_1000_std
      value: -7.511388196842074
    - type: nauc_mrr_at_100_diff1
      value: 46.56493524451518
    - type: nauc_mrr_at_100_max
      value: 33.61311557843383
    - type: nauc_mrr_at_100_std
      value: -7.503137722678137
    - type: nauc_mrr_at_10_diff1
      value: 46.48587625246975
    - type: nauc_mrr_at_10_max
      value: 33.56104741766235
    - type: nauc_mrr_at_10_std
      value: -7.798262408773109
    - type: nauc_mrr_at_1_diff1
      value: 50.92937737651317
    - type: nauc_mrr_at_1_max
      value: 32.9507362296752
    - type: nauc_mrr_at_1_std
      value: -8.423238646208265
    - type: nauc_mrr_at_20_diff1
      value: 46.50275775113446
    - type: nauc_mrr_at_20_max
      value: 33.58865514759019
    - type: nauc_mrr_at_20_std
      value: -7.570114941791467
    - type: nauc_mrr_at_3_diff1
      value: 46.89503971128471
    - type: nauc_mrr_at_3_max
      value: 33.496560503226625
    - type: nauc_mrr_at_3_std
      value: -8.210558822386304
    - type: nauc_mrr_at_5_diff1
      value: 46.52472719918368
    - type: nauc_mrr_at_5_max
      value: 33.47000614361767
    - type: nauc_mrr_at_5_std
      value: -8.047294277050185
    - type: nauc_ndcg_at_1000_diff1
      value: 45.952224716482064
    - type: nauc_ndcg_at_1000_max
      value: 33.55951998008019
    - type: nauc_ndcg_at_1000_std
      value: -6.526593883643845
    - type: nauc_ndcg_at_100_diff1
      value: 45.6076817241719
    - type: nauc_ndcg_at_100_max
      value: 33.56351746928194
    - type: nauc_ndcg_at_100_std
      value: -6.2577955941610375
    - type: nauc_ndcg_at_10_diff1
      value: 45.49263554465489
    - type: nauc_ndcg_at_10_max
      value: 32.64126996617623
    - type: nauc_ndcg_at_10_std
      value: -8.742955252041423
    - type: nauc_ndcg_at_1_diff1
      value: 50.92937737651317
    - type: nauc_ndcg_at_1_max
      value: 32.9507362296752
    - type: nauc_ndcg_at_1_std
      value: -8.423238646208265
    - type: nauc_ndcg_at_20_diff1
      value: 45.4342115120439
    - type: nauc_ndcg_at_20_max
      value: 33.104622212270726
    - type: nauc_ndcg_at_20_std
      value: -7.483803415235951
    - type: nauc_ndcg_at_3_diff1
      value: 46.31897453421016
    - type: nauc_ndcg_at_3_max
      value: 32.28721923806247
    - type: nauc_ndcg_at_3_std
      value: -9.54172365718084
    - type: nauc_ndcg_at_5_diff1
      value: 45.70298606925981
    - type: nauc_ndcg_at_5_max
      value: 32.261906390761105
    - type: nauc_ndcg_at_5_std
      value: -9.399257100607874
    - type: nauc_precision_at_1000_diff1
      value: -11.364874438217843
    - type: nauc_precision_at_1000_max
      value: 4.301890425063193
    - type: nauc_precision_at_1000_std
      value: 15.855742716005356
    - type: nauc_precision_at_100_diff1
      value: -4.982324099155143
    - type: nauc_precision_at_100_max
      value: 13.642061594719774
    - type: nauc_precision_at_100_std
      value: 18.81929325056801
    - type: nauc_precision_at_10_diff1
      value: 12.638394408088926
    - type: nauc_precision_at_10_max
      value: 25.306846945633808
    - type: nauc_precision_at_10_std
      value: 6.594949743766334
    - type: nauc_precision_at_1_diff1
      value: 50.92937737651317
    - type: nauc_precision_at_1_max
      value: 32.9507362296752
    - type: nauc_precision_at_1_std
      value: -8.423238646208265
    - type: nauc_precision_at_20_diff1
      value: 6.16872699781517
    - type: nauc_precision_at_20_max
      value: 22.181315927006374
    - type: nauc_precision_at_20_std
      value: 12.56367756338886
    - type: nauc_precision_at_3_diff1
      value: 28.83807305490845
    - type: nauc_precision_at_3_max
      value: 31.389218193103215
    - type: nauc_precision_at_3_std
      value: -1.896026766564083
    - type: nauc_precision_at_5_diff1
      value: 20.77453603262145
    - type: nauc_precision_at_5_max
      value: 28.91019461637974
    - type: nauc_precision_at_5_std
      value: 1.6398138794154224
    - type: nauc_recall_at_1000_diff1
      value: 32.58030229927583
    - type: nauc_recall_at_1000_max
      value: 51.575385962899944
    - type: nauc_recall_at_1000_std
      value: 42.279175457257395
    - type: nauc_recall_at_100_diff1
      value: 33.0346354270252
    - type: nauc_recall_at_100_max
      value: 37.59086973079201
    - type: nauc_recall_at_100_std
      value: 14.114518949779974
    - type: nauc_recall_at_10_diff1
      value: 37.76688949788438
    - type: nauc_recall_at_10_max
      value: 30.957649538205224
    - type: nauc_recall_at_10_std
      value: -7.51989142903617
    - type: nauc_recall_at_1_diff1
      value: 52.959829481566764
    - type: nauc_recall_at_1_max
      value: 28.644143760250785
    - type: nauc_recall_at_1_std
      value: -11.72163597077123
    - type: nauc_recall_at_20_diff1
      value: 36.1678225571237
    - type: nauc_recall_at_20_max
      value: 32.77154289601683
    - type: nauc_recall_at_20_std
      value: -1.4627763691409723
    - type: nauc_recall_at_3_diff1
      value: 42.36573375194426
    - type: nauc_recall_at_3_max
      value: 29.836155630039997
    - type: nauc_recall_at_3_std
      value: -10.921190546010779
    - type: nauc_recall_at_5_diff1
      value: 39.78782895608393
    - type: nauc_recall_at_5_max
      value: 29.974729083162995
    - type: nauc_recall_at_5_std
      value: -9.914213193369637
    - type: ndcg_at_1
      value: 37.584833333333336
    - type: ndcg_at_10
      value: 49.35933333333333
    - type: ndcg_at_100
      value: 54.516083333333334
    - type: ndcg_at_1000
      value: 56.13400000000001
    - type: ndcg_at_20
      value: 51.47983333333334
    - type: ndcg_at_3
      value: 43.94075
    - type: ndcg_at_5
      value: 46.43991666666667
    - type: precision_at_1
      value: 37.584833333333336
    - type: precision_at_10
      value: 8.754333333333332
    - type: precision_at_100
      value: 1.3438333333333334
    - type: precision_at_1000
      value: 0.16591666666666666
    - type: precision_at_20
      value: 5.135833333333332
    - type: precision_at_3
      value: 20.47383333333333
    - type: precision_at_5
      value: 14.480333333333334
    - type: recall_at_1
      value: 31.5475
    - type: recall_at_10
      value: 62.99808333333332
    - type: recall_at_100
      value: 85.16766666666666
    - type: recall_at_1000
      value: 95.88949999999998
    - type: recall_at_20
      value: 70.61158333333333
    - type: recall_at_3
      value: 47.78208333333333
    - type: recall_at_5
      value: 54.30466666666667
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackUnixRetrieval
      type: mteb/cqadupstack-unix
      config: default
      split: test
      revision: 6c6430d3a6d36f8d2a829195bc5dc94d7e063e53
    metrics:
    - type: main_score
      value: 51.409000000000006
    - type: map_at_1
      value: 33.44
    - type: map_at_10
      value: 45.242
    - type: map_at_100
      value: 46.457
    - type: map_at_1000
      value: 46.539
    - type: map_at_20
      value: 45.928999999999995
    - type: map_at_3
      value: 41.736000000000004
    - type: map_at_5
      value: 43.717
    - type: mrr_at_1
      value: 39.17910447761194
    - type: mrr_at_10
      value: 49.54868514570004
    - type: mrr_at_100
      value: 50.31474300711142
    - type: mrr_at_1000
      value: 50.35763716395954
    - type: mrr_at_20
      value: 49.99823659223059
    - type: mrr_at_3
      value: 46.8128109452736
    - type: mrr_at_5
      value: 48.45926616915417
    - type: nauc_map_at_1000_diff1
      value: 50.87257673340992
    - type: nauc_map_at_1000_max
      value: 40.34609374301027
    - type: nauc_map_at_1000_std
      value: -7.379981243726618
    - type: nauc_map_at_100_diff1
      value: 50.854157949159365
    - type: nauc_map_at_100_max
      value: 40.34032556006189
    - type: nauc_map_at_100_std
      value: -7.399964737756573
    - type: nauc_map_at_10_diff1
      value: 50.686246859628525
    - type: nauc_map_at_10_max
      value: 39.908128766187275
    - type: nauc_map_at_10_std
      value: -7.7328502513278625
    - type: nauc_map_at_1_diff1
      value: 55.57814128760479
    - type: nauc_map_at_1_max
      value: 38.478658985510826
    - type: nauc_map_at_1_std
      value: -6.372508238481584
    - type: nauc_map_at_20_diff1
      value: 50.772989231947626
    - type: nauc_map_at_20_max
      value: 40.23956514712802
    - type: nauc_map_at_20_std
      value: -7.514568627968219
    - type: nauc_map_at_3_diff1
      value: 52.014664217088544
    - type: nauc_map_at_3_max
      value: 39.734083375309915
    - type: nauc_map_at_3_std
      value: -7.926554803796402
    - type: nauc_map_at_5_diff1
      value: 51.01483620986479
    - type: nauc_map_at_5_max
      value: 39.45610862159722
    - type: nauc_map_at_5_std
      value: -8.27731392985267
    - type: nauc_mrr_at_1000_diff1
      value: 51.00481391598901
    - type: nauc_mrr_at_1000_max
      value: 42.212066475020265
    - type: nauc_mrr_at_1000_std
      value: -6.370874800186104
    - type: nauc_mrr_at_100_diff1
      value: 50.990520232150246
    - type: nauc_mrr_at_100_max
      value: 42.19016027339401
    - type: nauc_mrr_at_100_std
      value: -6.3827695296657145
    - type: nauc_mrr_at_10_diff1
      value: 50.744688903224954
    - type: nauc_mrr_at_10_max
      value: 42.11767789677446
    - type: nauc_mrr_at_10_std
      value: -6.497082850925394
    - type: nauc_mrr_at_1_diff1
      value: 55.54795613882778
    - type: nauc_mrr_at_1_max
      value: 43.333268044897565
    - type: nauc_mrr_at_1_std
      value: -5.456284327113586
    - type: nauc_mrr_at_20_diff1
      value: 50.8946692657115
    - type: nauc_mrr_at_20_max
      value: 42.131007988181466
    - type: nauc_mrr_at_20_std
      value: -6.474403898884448
    - type: nauc_mrr_at_3_diff1
      value: 51.41122299252956
    - type: nauc_mrr_at_3_max
      value: 42.43303267211499
    - type: nauc_mrr_at_3_std
      value: -6.499097476761323
    - type: nauc_mrr_at_5_diff1
      value: 50.94067629188639
    - type: nauc_mrr_at_5_max
      value: 41.914612395133574
    - type: nauc_mrr_at_5_std
      value: -7.173024101198252
    - type: nauc_ndcg_at_1000_diff1
      value: 49.671254442063336
    - type: nauc_ndcg_at_1000_max
      value: 41.233236425229265
    - type: nauc_ndcg_at_1000_std
      value: -5.974613943524345
    - type: nauc_ndcg_at_100_diff1
      value: 49.27027768005878
    - type: nauc_ndcg_at_100_max
      value: 40.948430026662564
    - type: nauc_ndcg_at_100_std
      value: -6.144610616966986
    - type: nauc_ndcg_at_10_diff1
      value: 48.558081201050165
    - type: nauc_ndcg_at_10_max
      value: 39.83487109315805
    - type: nauc_ndcg_at_10_std
      value: -7.615747684830626
    - type: nauc_ndcg_at_1_diff1
      value: 55.54795613882778
    - type: nauc_ndcg_at_1_max
      value: 43.333268044897565
    - type: nauc_ndcg_at_1_std
      value: -5.456284327113586
    - type: nauc_ndcg_at_20_diff1
      value: 48.892103792460844
    - type: nauc_ndcg_at_20_max
      value: 40.56965396855626
    - type: nauc_ndcg_at_20_std
      value: -7.033583531769024
    - type: nauc_ndcg_at_3_diff1
      value: 49.89643618093189
    - type: nauc_ndcg_at_3_max
      value: 40.22963794071276
    - type: nauc_ndcg_at_3_std
      value: -7.855589248597761
    - type: nauc_ndcg_at_5_diff1
      value: 48.921894655198365
    - type: nauc_ndcg_at_5_max
      value: 39.14662005574934
    - type: nauc_ndcg_at_5_std
      value: -8.845551763577872
    - type: nauc_precision_at_1000_diff1
      value: -14.518585158460978
    - type: nauc_precision_at_1000_max
      value: -1.7667784893915466
    - type: nauc_precision_at_1000_std
      value: 4.097998545067049
    - type: nauc_precision_at_100_diff1
      value: -4.950584630399553
    - type: nauc_precision_at_100_max
      value: 11.512730083218312
    - type: nauc_precision_at_100_std
      value: 6.330359665958284
    - type: nauc_precision_at_10_diff1
      value: 13.399849359324334
    - type: nauc_precision_at_10_max
      value: 26.855775987033937
    - type: nauc_precision_at_10_std
      value: -2.2873353847128644
    - type: nauc_precision_at_1_diff1
      value: 55.54795613882778
    - type: nauc_precision_at_1_max
      value: 43.333268044897565
    - type: nauc_precision_at_1_std
      value: -5.456284327113586
    - type: nauc_precision_at_20_diff1
      value: 7.679011471251583
    - type: nauc_precision_at_20_max
      value: 23.467700358632555
    - type: nauc_precision_at_20_std
      value: 1.1981871681272394
    - type: nauc_precision_at_3_diff1
      value: 32.921575397699506
    - type: nauc_precision_at_3_max
      value: 37.04097281242502
    - type: nauc_precision_at_3_std
      value: -5.360800309380987
    - type: nauc_precision_at_5_diff1
      value: 23.223401114141097
    - type: nauc_precision_at_5_max
      value: 31.530032692944605
    - type: nauc_precision_at_5_std
      value: -5.865853042470798
    - type: nauc_recall_at_1000_diff1
      value: 32.0155855987812
    - type: nauc_recall_at_1000_max
      value: 62.44988003291033
    - type: nauc_recall_at_1000_std
      value: 53.82320454819172
    - type: nauc_recall_at_100_diff1
      value: 36.65083199031551
    - type: nauc_recall_at_100_max
      value: 37.69410771344005
    - type: nauc_recall_at_100_std
      value: 3.579296637477123
    - type: nauc_recall_at_10_diff1
      value: 38.70173468166519
    - type: nauc_recall_at_10_max
      value: 34.1784276048144
    - type: nauc_recall_at_10_std
      value: -8.086019685277327
    - type: nauc_recall_at_1_diff1
      value: 55.57814128760479
    - type: nauc_recall_at_1_max
      value: 38.478658985510826
    - type: nauc_recall_at_1_std
      value: -6.372508238481584
    - type: nauc_recall_at_20_diff1
      value: 38.79450347259083
    - type: nauc_recall_at_20_max
      value: 36.05352697027188
    - type: nauc_recall_at_20_std
      value: -6.093850431049945
    - type: nauc_recall_at_3_diff1
      value: 45.74158065265736
    - type: nauc_recall_at_3_max
      value: 36.63626821782645
    - type: nauc_recall_at_3_std
      value: -9.653958457056982
    - type: nauc_recall_at_5_diff1
      value: 41.65880696047371
    - type: nauc_recall_at_5_max
      value: 33.8382122882109
    - type: nauc_recall_at_5_std
      value: -11.20106963946605
    - type: ndcg_at_1
      value: 39.179
    - type: ndcg_at_10
      value: 51.409000000000006
    - type: ndcg_at_100
      value: 56.499
    - type: ndcg_at_1000
      value: 58.062000000000005
    - type: ndcg_at_20
      value: 53.454
    - type: ndcg_at_3
      value: 45.754
    - type: ndcg_at_5
      value: 48.463
    - type: precision_at_1
      value: 39.179
    - type: precision_at_10
      value: 8.806
    - type: precision_at_100
      value: 1.2550000000000001
    - type: precision_at_1000
      value: 0.149
    - type: precision_at_20
      value: 5.009
    - type: precision_at_3
      value: 21.144
    - type: precision_at_5
      value: 14.832
    - type: recall_at_1
      value: 33.44
    - type: recall_at_10
      value: 65.496
    - type: recall_at_100
      value: 87.182
    - type: recall_at_1000
      value: 97.357
    - type: recall_at_20
      value: 72.697
    - type: recall_at_3
      value: 49.924
    - type: recall_at_5
      value: 56.95
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackWebmastersRetrieval
      type: mteb/cqadupstack-webmasters
      config: default
      split: test
      revision: 160c094312a0e1facb97e55eeddb698c0abe3571
    metrics:
    - type: main_score
      value: 48.375
    - type: map_at_1
      value: 30.793
    - type: map_at_10
      value: 41.662
    - type: map_at_100
      value: 43.66
    - type: map_at_1000
      value: 43.878
    - type: map_at_20
      value: 42.667
    - type: map_at_3
      value: 38.458999999999996
    - type: map_at_5
      value: 39.97
    - type: mrr_at_1
      value: 37.15415019762846
    - type: mrr_at_10
      value: 46.61584792019573
    - type: mrr_at_100
      value: 47.583978313689805
    - type: mrr_at_1000
      value: 47.61436921649715
    - type: mrr_at_20
      value: 47.16104598393294
    - type: mrr_at_3
      value: 44.23583662714098
    - type: mrr_at_5
      value: 45.29314888010541
    - type: nauc_map_at_1000_diff1
      value: 50.738532964091355
    - type: nauc_map_at_1000_max
      value: 33.1761869184962
    - type: nauc_map_at_1000_std
      value: -11.88545399582968
    - type: nauc_map_at_100_diff1
      value: 50.820635857587945
    - type: nauc_map_at_100_max
      value: 33.37659274306262
    - type: nauc_map_at_100_std
      value: -12.261098317018648
    - type: nauc_map_at_10_diff1
      value: 51.34955861172913
    - type: nauc_map_at_10_max
      value: 33.07036272698984
    - type: nauc_map_at_10_std
      value: -13.958268441726652
    - type: nauc_map_at_1_diff1
      value: 58.14264885967374
    - type: nauc_map_at_1_max
      value: 31.098191422332405
    - type: nauc_map_at_1_std
      value: -16.55201181770837
    - type: nauc_map_at_20_diff1
      value: 51.138925497848945
    - type: nauc_map_at_20_max
      value: 33.294483331998656
    - type: nauc_map_at_20_std
      value: -13.386238751309648
    - type: nauc_map_at_3_diff1
      value: 53.11933171962268
    - type: nauc_map_at_3_max
      value: 33.174584991640856
    - type: nauc_map_at_3_std
      value: -15.227875860055217
    - type: nauc_map_at_5_diff1
      value: 51.91013458222077
    - type: nauc_map_at_5_max
      value: 33.432034239350386
    - type: nauc_map_at_5_std
      value: -14.493952556516101
    - type: nauc_mrr_at_1000_diff1
      value: 49.46380145346334
    - type: nauc_mrr_at_1000_max
      value: 32.79378116341429
    - type: nauc_mrr_at_1000_std
      value: -10.714169233380185
    - type: nauc_mrr_at_100_diff1
      value: 49.45394564674785
    - type: nauc_mrr_at_100_max
      value: 32.7943550676381
    - type: nauc_mrr_at_100_std
      value: -10.696490620685783
    - type: nauc_mrr_at_10_diff1
      value: 49.500335538737914
    - type: nauc_mrr_at_10_max
      value: 32.77023244114561
    - type: nauc_mrr_at_10_std
      value: -11.104541089359515
    - type: nauc_mrr_at_1_diff1
      value: 52.76130402864484
    - type: nauc_mrr_at_1_max
      value: 31.114589410052044
    - type: nauc_mrr_at_1_std
      value: -12.937210710275965
    - type: nauc_mrr_at_20_diff1
      value: 49.414643398815365
    - type: nauc_mrr_at_20_max
      value: 32.763780752203516
    - type: nauc_mrr_at_20_std
      value: -10.804422561377299
    - type: nauc_mrr_at_3_diff1
      value: 50.01492870108368
    - type: nauc_mrr_at_3_max
      value: 32.72937861591098
    - type: nauc_mrr_at_3_std
      value: -11.940075063628994
    - type: nauc_mrr_at_5_diff1
      value: 49.48188504874961
    - type: nauc_mrr_at_5_max
      value: 33.16403773206102
    - type: nauc_mrr_at_5_std
      value: -11.21411630948482
    - type: nauc_ndcg_at_1000_diff1
      value: 48.54198944308599
    - type: nauc_ndcg_at_1000_max
      value: 33.76118694493479
    - type: nauc_ndcg_at_1000_std
      value: -8.65402138092725
    - type: nauc_ndcg_at_100_diff1
      value: 48.108850696506025
    - type: nauc_ndcg_at_100_max
      value: 33.84243712166641
    - type: nauc_ndcg_at_100_std
      value: -8.254554667297844
    - type: nauc_ndcg_at_10_diff1
      value: 47.89236428952843
    - type: nauc_ndcg_at_10_max
      value: 31.812029093395473
    - type: nauc_ndcg_at_10_std
      value: -11.127378110447985
    - type: nauc_ndcg_at_1_diff1
      value: 52.76130402864484
    - type: nauc_ndcg_at_1_max
      value: 31.114589410052044
    - type: nauc_ndcg_at_1_std
      value: -12.937210710275965
    - type: nauc_ndcg_at_20_diff1
      value: 47.905767671630315
    - type: nauc_ndcg_at_20_max
      value: 32.49208823548766
    - type: nauc_ndcg_at_20_std
      value: -10.250570357659894
    - type: nauc_ndcg_at_3_diff1
      value: 49.59377768692143
    - type: nauc_ndcg_at_3_max
      value: 33.13546546596274
    - type: nauc_ndcg_at_3_std
      value: -12.19125595753908
    - type: nauc_ndcg_at_5_diff1
      value: 48.35844341475799
    - type: nauc_ndcg_at_5_max
      value: 33.13927657899762
    - type: nauc_ndcg_at_5_std
      value: -11.300005449965582
    - type: nauc_precision_at_1000_diff1
      value: -16.480026591870523
    - type: nauc_precision_at_1000_max
      value: -15.181621988935524
    - type: nauc_precision_at_1000_std
      value: 34.719339551334855
    - type: nauc_precision_at_100_diff1
      value: -16.56707264200106
    - type: nauc_precision_at_100_max
      value: -6.877547823040516
    - type: nauc_precision_at_100_std
      value: 31.758215821939384
    - type: nauc_precision_at_10_diff1
      value: 4.772949413625673
    - type: nauc_precision_at_10_max
      value: 14.48563506451036
    - type: nauc_precision_at_10_std
      value: 12.151171571697414
    - type: nauc_precision_at_1_diff1
      value: 52.76130402864484
    - type: nauc_precision_at_1_max
      value: 31.114589410052044
    - type: nauc_precision_at_1_std
      value: -12.937210710275965
    - type: nauc_precision_at_20_diff1
      value: -5.247617701441084
    - type: nauc_precision_at_20_max
      value: 7.8524153059071065
    - type: nauc_precision_at_20_std
      value: 20.475057466275427
    - type: nauc_precision_at_3_diff1
      value: 29.307240726725464
    - type: nauc_precision_at_3_max
      value: 30.53776235029683
    - type: nauc_precision_at_3_std
      value: -1.9867363754853145
    - type: nauc_precision_at_5_diff1
      value: 16.82602124982839
    - type: nauc_precision_at_5_max
      value: 24.967617984133213
    - type: nauc_precision_at_5_std
      value: 3.7688940286519914
    - type: nauc_recall_at_1000_diff1
      value: 19.911102783538993
    - type: nauc_recall_at_1000_max
      value: 43.55994274840259
    - type: nauc_recall_at_1000_std
      value: 44.61688663280485
    - type: nauc_recall_at_100_diff1
      value: 25.00639435271183
    - type: nauc_recall_at_100_max
      value: 34.51865414347991
    - type: nauc_recall_at_100_std
      value: 18.406464007769454
    - type: nauc_recall_at_10_diff1
      value: 38.62687941260691
    - type: nauc_recall_at_10_max
      value: 27.489917928538553
    - type: nauc_recall_at_10_std
      value: -10.35234915862916
    - type: nauc_recall_at_1_diff1
      value: 58.14264885967374
    - type: nauc_recall_at_1_max
      value: 31.098191422332405
    - type: nauc_recall_at_1_std
      value: -16.55201181770837
    - type: nauc_recall_at_20_diff1
      value: 35.11800106234923
    - type: nauc_recall_at_20_max
      value: 28.356707989534385
    - type: nauc_recall_at_20_std
      value: -5.782361862032475
    - type: nauc_recall_at_3_diff1
      value: 47.010690556838405
    - type: nauc_recall_at_3_max
      value: 30.960698559313798
    - type: nauc_recall_at_3_std
      value: -14.716248620617172
    - type: nauc_recall_at_5_diff1
      value: 42.9526068288436
    - type: nauc_recall_at_5_max
      value: 31.419778612165533
    - type: nauc_recall_at_5_std
      value: -11.818424254829178
    - type: ndcg_at_1
      value: 37.153999999999996
    - type: ndcg_at_10
      value: 48.375
    - type: ndcg_at_100
      value: 54.657
    - type: ndcg_at_1000
      value: 56.208000000000006
    - type: ndcg_at_20
      value: 50.771
    - type: ndcg_at_3
      value: 43.315
    - type: ndcg_at_5
      value: 45.129000000000005
    - type: precision_at_1
      value: 37.153999999999996
    - type: precision_at_10
      value: 9.328
    - type: precision_at_100
      value: 1.9029999999999998
    - type: precision_at_1000
      value: 0.258
    - type: precision_at_20
      value: 5.998
    - type: precision_at_3
      value: 20.224
    - type: precision_at_5
      value: 14.347999999999999
    - type: recall_at_1
      value: 30.793
    - type: recall_at_10
      value: 60.999
    - type: recall_at_100
      value: 88.24499999999999
    - type: recall_at_1000
      value: 97.773
    - type: recall_at_20
      value: 69.702
    - type: recall_at_3
      value: 46.255
    - type: recall_at_5
      value: 51.245
  - task:
      type: Retrieval
    dataset:
      name: MTEB CQADupstackWordpressRetrieval
      type: mteb/cqadupstack-wordpress
      config: default
      split: test
      revision: 4ffe81d471b1924886b33c7567bfb200e9eec5c4
    metrics:
    - type: main_score
      value: 41.349000000000004
    - type: map_at_1
      value: 26.75
    - type: map_at_10
      value: 36.042
    - type: map_at_100
      value: 37.172
    - type: map_at_1000
      value: 37.261
    - type: map_at_20
      value: 36.66
    - type: map_at_3
      value: 33.235
    - type: map_at_5
      value: 34.748000000000005
    - type: mrr_at_1
      value: 29.390018484288355
    - type: mrr_at_10
      value: 38.4025760643136
    - type: mrr_at_100
      value: 39.374703522095395
    - type: mrr_at_1000
      value: 39.42972569352847
    - type: mrr_at_20
      value: 38.93955238768051
    - type: mrr_at_3
      value: 36.013555144793614
    - type: mrr_at_5
      value: 37.2520024645718
    - type: nauc_map_at_1000_diff1
      value: 44.69823016014606
    - type: nauc_map_at_1000_max
      value: 25.57190426738162
    - type: nauc_map_at_1000_std
      value: -4.199140067047161
    - type: nauc_map_at_100_diff1
      value: 44.683770406187875
    - type: nauc_map_at_100_max
      value: 25.551408403995257
    - type: nauc_map_at_100_std
      value: -4.218572010835323
    - type: nauc_map_at_10_diff1
      value: 44.68530737786573
    - type: nauc_map_at_10_max
      value: 25.46193155573604
    - type: nauc_map_at_10_std
      value: -4.809871031910446
    - type: nauc_map_at_1_diff1
      value: 50.41571355104115
    - type: nauc_map_at_1_max
      value: 26.581260847509704
    - type: nauc_map_at_1_std
      value: -5.403238214693907
    - type: nauc_map_at_20_diff1
      value: 44.731965188076956
    - type: nauc_map_at_20_max
      value: 25.404018335678042
    - type: nauc_map_at_20_std
      value: -4.518115190513196
    - type: nauc_map_at_3_diff1
      value: 45.72733737454689
    - type: nauc_map_at_3_max
      value: 25.16236634356437
    - type: nauc_map_at_3_std
      value: -5.210810848188912
    - type: nauc_map_at_5_diff1
      value: 45.04362118675467
    - type: nauc_map_at_5_max
      value: 25.256832347187792
    - type: nauc_map_at_5_std
      value: -4.665177712989629
    - type: nauc_mrr_at_1000_diff1
      value: 43.96570681453743
    - type: nauc_mrr_at_1000_max
      value: 25.515577482173303
    - type: nauc_mrr_at_1000_std
      value: -3.1318312163116167
    - type: nauc_mrr_at_100_diff1
      value: 43.94835648436942
    - type: nauc_mrr_at_100_max
      value: 25.485710237620257
    - type: nauc_mrr_at_100_std
      value: -3.1262634160182587
    - type: nauc_mrr_at_10_diff1
      value: 43.87989114303318
    - type: nauc_mrr_at_10_max
      value: 25.561703958752073
    - type: nauc_mrr_at_10_std
      value: -3.5337096979285465
    - type: nauc_mrr_at_1_diff1
      value: 50.5769748938826
    - type: nauc_mrr_at_1_max
      value: 27.540216184434602
    - type: nauc_mrr_at_1_std
      value: -4.3410331054744455
    - type: nauc_mrr_at_20_diff1
      value: 43.89090600752474
    - type: nauc_mrr_at_20_max
      value: 25.35538914450936
    - type: nauc_mrr_at_20_std
      value: -3.256848712300088
    - type: nauc_mrr_at_3_diff1
      value: 44.67145787977651
    - type: nauc_mrr_at_3_max
      value: 25.743032202078233
    - type: nauc_mrr_at_3_std
      value: -3.543961143296222
    - type: nauc_mrr_at_5_diff1
      value: 44.1410906123774
    - type: nauc_mrr_at_5_max
      value: 25.512981453020377
    - type: nauc_mrr_at_5_std
      value: -3.3984260964459625
    - type: nauc_ndcg_at_1000_diff1
      value: 42.094467874822634
    - type: nauc_ndcg_at_1000_max
      value: 25.773789329652143
    - type: nauc_ndcg_at_1000_std
      value: -1.5030137154663146
    - type: nauc_ndcg_at_100_diff1
      value: 41.551311444176505
    - type: nauc_ndcg_at_100_max
      value: 25.41326272306838
    - type: nauc_ndcg_at_100_std
      value: -1.2565322587434289
    - type: nauc_ndcg_at_10_diff1
      value: 41.692329741760844
    - type: nauc_ndcg_at_10_max
      value: 24.973824605697946
    - type: nauc_ndcg_at_10_std
      value: -4.0454407772294445
    - type: nauc_ndcg_at_1_diff1
      value: 50.5769748938826
    - type: nauc_ndcg_at_1_max
      value: 27.540216184434602
    - type: nauc_ndcg_at_1_std
      value: -4.3410331054744455
    - type: nauc_ndcg_at_20_diff1
      value: 41.7849741522554
    - type: nauc_ndcg_at_20_max
      value: 24.483461844450098
    - type: nauc_ndcg_at_20_std
      value: -3.0192185885852267
    - type: nauc_ndcg_at_3_diff1
      value: 43.50095372671906
    - type: nauc_ndcg_at_3_max
      value: 25.0660548267931
    - type: nauc_ndcg_at_3_std
      value: -4.136658038209795
    - type: nauc_ndcg_at_5_diff1
      value: 42.56860328119003
    - type: nauc_ndcg_at_5_max
      value: 24.64471019866571
    - type: nauc_ndcg_at_5_std
      value: -3.7919812365370316
    - type: nauc_precision_at_1000_diff1
      value: -11.608868871826067
    - type: nauc_precision_at_1000_max
      value: -4.774237268127937
    - type: nauc_precision_at_1000_std
      value: 12.15076818010773
    - type: nauc_precision_at_100_diff1
      value: 1.9653391598989818
    - type: nauc_precision_at_100_max
      value: 14.82175127203874
    - type: nauc_precision_at_100_std
      value: 19.14581435930739
    - type: nauc_precision_at_10_diff1
      value: 24.310184596872997
    - type: nauc_precision_at_10_max
      value: 24.654364730313127
    - type: nauc_precision_at_10_std
      value: 3.834736733208166
    - type: nauc_precision_at_1_diff1
      value: 50.5769748938826
    - type: nauc_precision_at_1_max
      value: 27.540216184434602
    - type: nauc_precision_at_1_std
      value: -4.3410331054744455
    - type: nauc_precision_at_20_diff1
      value: 20.31741982412239
    - type: nauc_precision_at_20_max
      value: 21.813185907394
    - type: nauc_precision_at_20_std
      value: 8.67748469930042
    - type: nauc_precision_at_3_diff1
      value: 36.23426146022416
    - type: nauc_precision_at_3_max
      value: 25.085104352996147
    - type: nauc_precision_at_3_std
      value: -0.13994055865810526
    - type: nauc_precision_at_5_diff1
      value: 30.713670782259456
    - type: nauc_precision_at_5_max
      value: 25.073465240016198
    - type: nauc_precision_at_5_std
      value: 2.903773154373253
    - type: nauc_recall_at_1000_diff1
      value: 14.861338959184192
    - type: nauc_recall_at_1000_max
      value: 38.46379100413754
    - type: nauc_recall_at_1000_std
      value: 40.82683088866469
    - type: nauc_recall_at_100_diff1
      value: 24.540319510278348
    - type: nauc_recall_at_100_max
      value: 24.172628109630832
    - type: nauc_recall_at_100_std
      value: 16.567712965914602
    - type: nauc_recall_at_10_diff1
      value: 31.92224903523137
    - type: nauc_recall_at_10_max
      value: 22.064974975663127
    - type: nauc_recall_at_10_std
      value: -3.156058361445988
    - type: nauc_recall_at_1_diff1
      value: 50.41571355104115
    - type: nauc_recall_at_1_max
      value: 26.581260847509704
    - type: nauc_recall_at_1_std
      value: -5.403238214693907
    - type: nauc_recall_at_20_diff1
      value: 31.409257808669842
    - type: nauc_recall_at_20_max
      value: 19.307470123424853
    - type: nauc_recall_at_20_std
      value: 0.8921848838324672
    - type: nauc_recall_at_3_diff1
      value: 37.83159917842702
    - type: nauc_recall_at_3_max
      value: 22.128986921876365
    - type: nauc_recall_at_3_std
      value: -4.332761965568785
    - type: nauc_recall_at_5_diff1
      value: 35.43509187423654
    - type: nauc_recall_at_5_max
      value: 21.559603832786657
    - type: nauc_recall_at_5_std
      value: -2.7879479079841327
    - type: ndcg_at_1
      value: 29.39
    - type: ndcg_at_10
      value: 41.349000000000004
    - type: ndcg_at_100
      value: 46.814
    - type: ndcg_at_1000
      value: 48.748000000000005
    - type: ndcg_at_20
      value: 43.491
    - type: ndcg_at_3
      value: 36.120000000000005
    - type: ndcg_at_5
      value: 38.415
    - type: precision_at_1
      value: 29.39
    - type: precision_at_10
      value: 6.451
    - type: precision_at_100
      value: 0.991
    - type: precision_at_1000
      value: 0.128
    - type: precision_at_20
      value: 3.762
    - type: precision_at_3
      value: 15.588
    - type: precision_at_5
      value: 10.795
    - type: recall_at_1
      value: 26.75
    - type: recall_at_10
      value: 55.397
    - type: recall_at_100
      value: 80.247
    - type: recall_at_1000
      value: 94.207
    - type: recall_at_20
      value: 63.55499999999999
    - type: recall_at_3
      value: 41.083999999999996
    - type: recall_at_5
      value: 46.58
  - task:
      type: Retrieval
    dataset:
      name: MTEB ClimateFEVER
      type: mteb/climate-fever
      config: default
      split: test
      revision: 47f2ac6acb640fc46020b02a5b59fdda04d39380
    metrics:
    - type: main_score
      value: 43.469
    - type: map_at_1
      value: 19.506999999999998
    - type: map_at_10
      value: 33.016
    - type: map_at_100
      value: 35.36
    - type: map_at_1000
      value: 35.515
    - type: map_at_20
      value: 34.323
    - type: map_at_3
      value: 27.862
    - type: map_at_5
      value: 30.612000000000002
    - type: mrr_at_1
      value: 44.16938110749186
    - type: mrr_at_10
      value: 56.57685745307904
    - type: mrr_at_100
      value: 57.17414254225016
    - type: mrr_at_1000
      value: 57.189032189089495
    - type: mrr_at_20
      value: 56.97649801229595
    - type: mrr_at_3
      value: 53.84364820846914
    - type: mrr_at_5
      value: 55.55048859934868
    - type: nauc_map_at_1000_diff1
      value: 24.602536884273523
    - type: nauc_map_at_1000_max
      value: 39.26487354477874
    - type: nauc_map_at_1000_std
      value: 22.94302438231403
    - type: nauc_map_at_100_diff1
      value: 24.592347616537754
    - type: nauc_map_at_100_max
      value: 39.228370594048044
    - type: nauc_map_at_100_std
      value: 22.91028538467064
    - type: nauc_map_at_10_diff1
      value: 25.211737206439466
    - type: nauc_map_at_10_max
      value: 39.14645027724652
    - type: nauc_map_at_10_std
      value: 21.645361248764246
    - type: nauc_map_at_1_diff1
      value: 34.574022172223785
    - type: nauc_map_at_1_max
      value: 36.80960969907521
    - type: nauc_map_at_1_std
      value: 14.745037917509043
    - type: nauc_map_at_20_diff1
      value: 24.522877050053797
    - type: nauc_map_at_20_max
      value: 39.059341666216426
    - type: nauc_map_at_20_std
      value: 22.4609918713542
    - type: nauc_map_at_3_diff1
      value: 27.15813672283225
    - type: nauc_map_at_3_max
      value: 38.14947129547116
    - type: nauc_map_at_3_std
      value: 18.37694411131855
    - type: nauc_map_at_5_diff1
      value: 26.3963128622898
    - type: nauc_map_at_5_max
      value: 38.79462114513801
    - type: nauc_map_at_5_std
      value: 19.904846635683718
    - type: nauc_mrr_at_1000_diff1
      value: 24.390212975354274
    - type: nauc_mrr_at_1000_max
      value: 37.575264384207465
    - type: nauc_mrr_at_1000_std
      value: 22.607616532255875
    - type: nauc_mrr_at_100_diff1
      value: 24.38096540780017
    - type: nauc_mrr_at_100_max
      value: 37.585671997802656
    - type: nauc_mrr_at_100_std
      value: 22.625502455820666
    - type: nauc_mrr_at_10_diff1
      value: 24.240023464772193
    - type: nauc_mrr_at_10_max
      value: 37.624380443643524
    - type: nauc_mrr_at_10_std
      value: 22.694399526110466
    - type: nauc_mrr_at_1_diff1
      value: 28.020125669466562
    - type: nauc_mrr_at_1_max
      value: 34.02386180115898
    - type: nauc_mrr_at_1_std
      value: 17.835724317244686
    - type: nauc_mrr_at_20_diff1
      value: 24.333355652108292
    - type: nauc_mrr_at_20_max
      value: 37.57796475058575
    - type: nauc_mrr_at_20_std
      value: 22.704917335783062
    - type: nauc_mrr_at_3_diff1
      value: 24.9739147862957
    - type: nauc_mrr_at_3_max
      value: 37.960296534359685
    - type: nauc_mrr_at_3_std
      value: 21.93607347433575
    - type: nauc_mrr_at_5_diff1
      value: 24.320129475684165
    - type: nauc_mrr_at_5_max
      value: 37.58866607632526
    - type: nauc_mrr_at_5_std
      value: 22.31442317668481
    - type: nauc_ndcg_at_1000_diff1
      value: 21.893106953223356
    - type: nauc_ndcg_at_1000_max
      value: 40.38192211749562
    - type: nauc_ndcg_at_1000_std
      value: 27.943530727839622
    - type: nauc_ndcg_at_100_diff1
      value: 21.476881814995785
    - type: nauc_ndcg_at_100_max
      value: 39.91597694502497
    - type: nauc_ndcg_at_100_std
      value: 27.80086195626175
    - type: nauc_ndcg_at_10_diff1
      value: 22.788155104417537
    - type: nauc_ndcg_at_10_max
      value: 39.64018481724029
    - type: nauc_ndcg_at_10_std
      value: 24.608760819228856
    - type: nauc_ndcg_at_1_diff1
      value: 28.020125669466562
    - type: nauc_ndcg_at_1_max
      value: 34.02386180115898
    - type: nauc_ndcg_at_1_std
      value: 17.835724317244686
    - type: nauc_ndcg_at_20_diff1
      value: 21.435037904375516
    - type: nauc_ndcg_at_20_max
      value: 39.41545921639339
    - type: nauc_ndcg_at_20_std
      value: 26.302180505922152
    - type: nauc_ndcg_at_3_diff1
      value: 24.37753699681809
    - type: nauc_ndcg_at_3_max
      value: 37.92832349922249
    - type: nauc_ndcg_at_3_std
      value: 20.314267862236697
    - type: nauc_ndcg_at_5_diff1
      value: 24.489993763202634
    - type: nauc_ndcg_at_5_max
      value: 39.322948140029744
    - type: nauc_ndcg_at_5_std
      value: 22.069807417424485
    - type: nauc_precision_at_1000_diff1
      value: -16.048547778222588
    - type: nauc_precision_at_1000_max
      value: -3.205412586478899
    - type: nauc_precision_at_1000_std
      value: 14.433544284750797
    - type: nauc_precision_at_100_diff1
      value: -11.787991777545036
    - type: nauc_precision_at_100_max
      value: 6.850986771358883
    - type: nauc_precision_at_100_std
      value: 22.572974966148244
    - type: nauc_precision_at_10_diff1
      value: -0.5111959706315438
    - type: nauc_precision_at_10_max
      value: 22.560355393578128
    - type: nauc_precision_at_10_std
      value: 25.562322716450424
    - type: nauc_precision_at_1_diff1
      value: 28.020125669466562
    - type: nauc_precision_at_1_max
      value: 34.02386180115898
    - type: nauc_precision_at_1_std
      value: 17.835724317244686
    - type: nauc_precision_at_20_diff1
      value: -6.0772940189383275
    - type: nauc_precision_at_20_max
      value: 17.194360329332213
    - type: nauc_precision_at_20_std
      value: 26.551077839343566
    - type: nauc_precision_at_3_diff1
      value: 10.033294854519573
    - type: nauc_precision_at_3_max
      value: 31.72453436391336
    - type: nauc_precision_at_3_std
      value: 22.294966409945427
    - type: nauc_precision_at_5_diff1
      value: 6.237641122443952
    - type: nauc_precision_at_5_max
      value: 28.3251946189731
    - type: nauc_precision_at_5_std
      value: 23.742964477476097
    - type: nauc_recall_at_1000_diff1
      value: 7.066317014709414
    - type: nauc_recall_at_1000_max
      value: 41.26207890590803
    - type: nauc_recall_at_1000_std
      value: 48.082120972049324
    - type: nauc_recall_at_100_diff1
      value: 8.5605869633491
    - type: nauc_recall_at_100_max
      value: 34.21516017657153
    - type: nauc_recall_at_100_std
      value: 36.23370174719997
    - type: nauc_recall_at_10_diff1
      value: 15.894026727549823
    - type: nauc_recall_at_10_max
      value: 35.7217710490404
    - type: nauc_recall_at_10_std
      value: 25.411329590972702
    - type: nauc_recall_at_1_diff1
      value: 34.574022172223785
    - type: nauc_recall_at_1_max
      value: 36.80960969907521
    - type: nauc_recall_at_1_std
      value: 14.745037917509043
    - type: nauc_recall_at_20_diff1
      value: 11.044245946655797
    - type: nauc_recall_at_20_max
      value: 33.321827723279846
    - type: nauc_recall_at_20_std
      value: 28.839341482904228
    - type: nauc_recall_at_3_diff1
      value: 23.574156335947677
    - type: nauc_recall_at_3_max
      value: 38.36490056324833
    - type: nauc_recall_at_3_std
      value: 19.781669176069148
    - type: nauc_recall_at_5_diff1
      value: 20.375492803538272
    - type: nauc_recall_at_5_max
      value: 37.13169592173094
    - type: nauc_recall_at_5_std
      value: 21.698652331981503
    - type: ndcg_at_1
      value: 44.169000000000004
    - type: ndcg_at_10
      value: 43.469
    - type: ndcg_at_100
      value: 51.056000000000004
    - type: ndcg_at_1000
      value: 53.467
    - type: ndcg_at_20
      value: 46.601
    - type: ndcg_at_3
      value: 37.138
    - type: ndcg_at_5
      value: 39.286
    - type: precision_at_1
      value: 44.169000000000004
    - type: precision_at_10
      value: 13.316
    - type: precision_at_100
      value: 2.149
    - type: precision_at_1000
      value: 0.261
    - type: precision_at_20
      value: 8.01
    - type: precision_at_3
      value: 27.839000000000002
    - type: precision_at_5
      value: 20.846999999999998
    - type: recall_at_1
      value: 19.506999999999998
    - type: recall_at_10
      value: 49.242000000000004
    - type: recall_at_100
      value: 74.421
    - type: recall_at_1000
      value: 87.53699999999999
    - type: recall_at_20
      value: 57.992
    - type: recall_at_3
      value: 33.024
    - type: recall_at_5
      value: 40.178000000000004
  - task:
      type: Retrieval
    dataset:
      name: MTEB DBPedia
      type: mteb/dbpedia
      config: default
      split: test
      revision: c0f706b76e590d620bd6618b3ca8efdd34e2d659
    metrics:
    - type: main_score
      value: 50.815999999999995
    - type: map_at_1
      value: 10.4
    - type: map_at_10
      value: 24.509
    - type: map_at_100
      value: 35.888
    - type: map_at_1000
      value: 37.881
    - type: map_at_20
      value: 29.248
    - type: map_at_3
      value: 16.683
    - type: map_at_5
      value: 20.121
    - type: mrr_at_1
      value: 76.5
    - type: mrr_at_10
      value: 82.96865079365078
    - type: mrr_at_100
      value: 83.15565684386043
    - type: mrr_at_1000
      value: 83.16234347576268
    - type: mrr_at_20
      value: 83.10610208827119
    - type: mrr_at_3
      value: 81.875
    - type: mrr_at_5
      value: 82.53749999999998
    - type: nauc_map_at_1000_diff1
      value: 23.772111749199244
    - type: nauc_map_at_1000_max
      value: 30.20334223785286
    - type: nauc_map_at_1000_std
      value: 18.05771740348393
    - type: nauc_map_at_100_diff1
      value: 24.99922400559097
    - type: nauc_map_at_100_max
      value: 30.227680457273554
    - type: nauc_map_at_100_std
      value: 15.266796337809208
    - type: nauc_map_at_10_diff1
      value: 26.33907059260499
    - type: nauc_map_at_10_max
      value: 21.35352795885219
    - type: nauc_map_at_10_std
      value: -11.676283379701461
    - type: nauc_map_at_1_diff1
      value: 30.9428537478304
    - type: nauc_map_at_1_max
      value: 10.706776298253795
    - type: nauc_map_at_1_std
      value: -27.48789516952886
    - type: nauc_map_at_20_diff1
      value: 26.028744882022643
    - type: nauc_map_at_20_max
      value: 25.540897708997857
    - type: nauc_map_at_20_std
      value: -2.1138409738399333
    - type: nauc_map_at_3_diff1
      value: 28.569060478595414
    - type: nauc_map_at_3_max
      value: 16.03075218426638
    - type: nauc_map_at_3_std
      value: -23.289456267507518
    - type: nauc_map_at_5_diff1
      value: 27.77252783978944
    - type: nauc_map_at_5_max
      value: 17.558788618934244
    - type: nauc_map_at_5_std
      value: -19.879370566923726
    - type: nauc_mrr_at_1000_diff1
      value: 56.24197871190471
    - type: nauc_mrr_at_1000_max
      value: 65.80135088215289
    - type: nauc_mrr_at_1000_std
      value: 41.37855291304919
    - type: nauc_mrr_at_100_diff1
      value: 56.23288710496704
    - type: nauc_mrr_at_100_max
      value: 65.80061767216726
    - type: nauc_mrr_at_100_std
      value: 41.36772467988576
    - type: nauc_mrr_at_10_diff1
      value: 56.324447358144745
    - type: nauc_mrr_at_10_max
      value: 65.81370075569146
    - type: nauc_mrr_at_10_std
      value: 41.410460564882776
    - type: nauc_mrr_at_1_diff1
      value: 59.65250965250966
    - type: nauc_mrr_at_1_max
      value: 63.83691383691382
    - type: nauc_mrr_at_1_std
      value: 36.73343673343676
    - type: nauc_mrr_at_20_diff1
      value: 56.1707409830787
    - type: nauc_mrr_at_20_max
      value: 65.69720497776981
    - type: nauc_mrr_at_20_std
      value: 41.26487560092242
    - type: nauc_mrr_at_3_diff1
      value: 54.9129569183045
    - type: nauc_mrr_at_3_max
      value: 65.99486075421906
    - type: nauc_mrr_at_3_std
      value: 41.95372363821559
    - type: nauc_mrr_at_5_diff1
      value: 56.16135725971244
    - type: nauc_mrr_at_5_max
      value: 66.3010887352757
    - type: nauc_mrr_at_5_std
      value: 42.00610529557167
    - type: nauc_ndcg_at_1000_diff1
      value: 32.70929215628561
    - type: nauc_ndcg_at_1000_max
      value: 47.10806967197569
    - type: nauc_ndcg_at_1000_std
      value: 35.00425836800715
    - type: nauc_ndcg_at_100_diff1
      value: 35.06646341481841
    - type: nauc_ndcg_at_100_max
      value: 45.39744548573974
    - type: nauc_ndcg_at_100_std
      value: 27.047969181217844
    - type: nauc_ndcg_at_10_diff1
      value: 27.274830141666424
    - type: nauc_ndcg_at_10_max
      value: 42.504020954653996
    - type: nauc_ndcg_at_10_std
      value: 22.697762917174995
    - type: nauc_ndcg_at_1_diff1
      value: 50.08311936617783
    - type: nauc_ndcg_at_1_max
      value: 54.73568887554088
    - type: nauc_ndcg_at_1_std
      value: 26.170967864741694
    - type: nauc_ndcg_at_20_diff1
      value: 31.242689219374427
    - type: nauc_ndcg_at_20_max
      value: 42.541920517016614
    - type: nauc_ndcg_at_20_std
      value: 18.96423111373813
    - type: nauc_ndcg_at_3_diff1
      value: 28.826757289224155
    - type: nauc_ndcg_at_3_max
      value: 43.58945597798035
    - type: nauc_ndcg_at_3_std
      value: 24.087165156193166
    - type: nauc_ndcg_at_5_diff1
      value: 26.119279113418546
    - type: nauc_ndcg_at_5_max
      value: 40.679930238997535
    - type: nauc_ndcg_at_5_std
      value: 23.46459132364594
    - type: nauc_precision_at_1000_diff1
      value: -21.84770974908615
    - type: nauc_precision_at_1000_max
      value: -14.093701963931426
    - type: nauc_precision_at_1000_std
      value: 9.299725592056397
    - type: nauc_precision_at_100_diff1
      value: -10.260185699059837
    - type: nauc_precision_at_100_max
      value: 9.810522145982985
    - type: nauc_precision_at_100_std
      value: 44.20627482372792
    - type: nauc_precision_at_10_diff1
      value: -4.519747556705346
    - type: nauc_precision_at_10_max
      value: 22.419340914046078
    - type: nauc_precision_at_10_std
      value: 45.53510067051897
    - type: nauc_precision_at_1_diff1
      value: 59.65250965250966
    - type: nauc_precision_at_1_max
      value: 63.83691383691382
    - type: nauc_precision_at_1_std
      value: 36.73343673343676
    - type: nauc_precision_at_20_diff1
      value: -4.894217383220783
    - type: nauc_precision_at_20_max
      value: 20.026284106419716
    - type: nauc_precision_at_20_std
      value: 46.826549838338885
    - type: nauc_precision_at_3_diff1
      value: 8.255495021604343
    - type: nauc_precision_at_3_max
      value: 32.41871125305279
    - type: nauc_precision_at_3_std
      value: 39.37854593274469
    - type: nauc_precision_at_5_diff1
      value: 0.8399922914701591
    - type: nauc_precision_at_5_max
      value: 25.576701242406784
    - type: nauc_precision_at_5_std
      value: 41.43316549318606
    - type: nauc_recall_at_1000_diff1
      value: 26.933682703442607
    - type: nauc_recall_at_1000_max
      value: 41.242862989732615
    - type: nauc_recall_at_1000_std
      value: 47.718397116276726
    - type: nauc_recall_at_100_diff1
      value: 28.66794019735935
    - type: nauc_recall_at_100_max
      value: 33.70954178154391
    - type: nauc_recall_at_100_std
      value: 20.337812189448144
    - type: nauc_recall_at_10_diff1
      value: 23.98560937572333
    - type: nauc_recall_at_10_max
      value: 17.85589161042591
    - type: nauc_recall_at_10_std
      value: -15.460067168640327
    - type: nauc_recall_at_1_diff1
      value: 30.9428537478304
    - type: nauc_recall_at_1_max
      value: 10.706776298253795
    - type: nauc_recall_at_1_std
      value: -27.48789516952886
    - type: nauc_recall_at_20_diff1
      value: 24.528494602453677
    - type: nauc_recall_at_20_max
      value: 22.39686785999968
    - type: nauc_recall_at_20_std
      value: -6.8755605379050495
    - type: nauc_recall_at_3_diff1
      value: 24.352067402718824
    - type: nauc_recall_at_3_max
      value: 13.630657148502184
    - type: nauc_recall_at_3_std
      value: -24.752279121894848
    - type: nauc_recall_at_5_diff1
      value: 23.93262400173538
    - type: nauc_recall_at_5_max
      value: 14.158970487334082
    - type: nauc_recall_at_5_std
      value: -22.37672315523696
    - type: ndcg_at_1
      value: 64.75
    - type: ndcg_at_10
      value: 50.815999999999995
    - type: ndcg_at_100
      value: 55.981
    - type: ndcg_at_1000
      value: 62.857
    - type: ndcg_at_20
      value: 50.283
    - type: ndcg_at_3
      value: 56.232000000000006
    - type: ndcg_at_5
      value: 53.303999999999995
    - type: precision_at_1
      value: 76.5
    - type: precision_at_10
      value: 40.9
    - type: precision_at_100
      value: 13.01
    - type: precision_at_1000
      value: 2.496
    - type: precision_at_20
      value: 31.525
    - type: precision_at_3
      value: 59.667
    - type: precision_at_5
      value: 51.5
    - type: recall_at_1
      value: 10.4
    - type: recall_at_10
      value: 29.837000000000003
    - type: recall_at_100
      value: 62.495999999999995
    - type: recall_at_1000
      value: 84.179
    - type: recall_at_20
      value: 39.745000000000005
    - type: recall_at_3
      value: 17.772
    - type: recall_at_5
      value: 22.732
  - task:
      type: Retrieval
    dataset:
      name: MTEB FEVER
      type: mteb/fever
      config: default
      split: test
      revision: bea83ef9e8fb933d90a2f1d5515737465d613e12
    metrics:
    - type: main_score
      value: 93.147
    - type: map_at_1
      value: 84.123
    - type: map_at_10
      value: 90.793
    - type: map_at_100
      value: 91.00399999999999
    - type: map_at_1000
      value: 91.014
    - type: map_at_20
      value: 90.929
    - type: map_at_3
      value: 90.01
    - type: map_at_5
      value: 90.514
    - type: mrr_at_1
      value: 90.6090609060906
    - type: mrr_at_10
      value: 94.56931407426447
    - type: mrr_at_100
      value: 94.5981688826583
    - type: mrr_at_1000
      value: 94.59839036307305
    - type: mrr_at_20
      value: 94.58933347392538
    - type: mrr_at_3
      value: 94.39443944394432
    - type: mrr_at_5
      value: 94.52720272027192
    - type: nauc_map_at_1000_diff1
      value: 47.79099845895175
    - type: nauc_map_at_1000_max
      value: 27.497877436060126
    - type: nauc_map_at_1000_std
      value: -8.13339253954977
    - type: nauc_map_at_100_diff1
      value: 47.73289128218074
    - type: nauc_map_at_100_max
      value: 27.47233674805432
    - type: nauc_map_at_100_std
      value: -8.116906996417276
    - type: nauc_map_at_10_diff1
      value: 47.11991698822012
    - type: nauc_map_at_10_max
      value: 27.043478885296818
    - type: nauc_map_at_10_std
      value: -8.041555396807254
    - type: nauc_map_at_1_diff1
      value: 54.62356861092832
    - type: nauc_map_at_1_max
      value: 25.79991281991449
    - type: nauc_map_at_1_std
      value: -10.727885287362989
    - type: nauc_map_at_20_diff1
      value: 47.355948038923415
    - type: nauc_map_at_20_max
      value: 27.377496866209412
    - type: nauc_map_at_20_std
      value: -7.964383745017635
    - type: nauc_map_at_3_diff1
      value: 46.250567821995816
    - type: nauc_map_at_3_max
      value: 26.720427753104087
    - type: nauc_map_at_3_std
      value: -8.720105706265599
    - type: nauc_map_at_5_diff1
      value: 46.60720659354551
    - type: nauc_map_at_5_max
      value: 26.571065579915974
    - type: nauc_map_at_5_std
      value: -8.595067960972495
    - type: nauc_mrr_at_1000_diff1
      value: 73.70855511936261
    - type: nauc_mrr_at_1000_max
      value: 34.73984488188905
    - type: nauc_mrr_at_1000_std
      value: -19.808375433256
    - type: nauc_mrr_at_100_diff1
      value: 73.7096330945882
    - type: nauc_mrr_at_100_max
      value: 34.742520612749445
    - type: nauc_mrr_at_100_std
      value: -19.803463171450023
    - type: nauc_mrr_at_10_diff1
      value: 73.71314616789961
    - type: nauc_mrr_at_10_max
      value: 34.947852652846485
    - type: nauc_mrr_at_10_std
      value: -19.759110050207276
    - type: nauc_mrr_at_1_diff1
      value: 74.52821692195837
    - type: nauc_mrr_at_1_max
      value: 32.2133212833154
    - type: nauc_mrr_at_1_std
      value: -18.97663485312286
    - type: nauc_mrr_at_20_diff1
      value: 73.69023729557055
    - type: nauc_mrr_at_20_max
      value: 34.80486237439106
    - type: nauc_mrr_at_20_std
      value: -19.691951099200146
    - type: nauc_mrr_at_3_diff1
      value: 73.43522847167395
    - type: nauc_mrr_at_3_max
      value: 35.072062525904414
    - type: nauc_mrr_at_3_std
      value: -20.938095342419672
    - type: nauc_mrr_at_5_diff1
      value: 73.69029982038052
    - type: nauc_mrr_at_5_max
      value: 35.14296188327372
    - type: nauc_mrr_at_5_std
      value: -20.10654798165351
    - type: nauc_ndcg_at_1000_diff1
      value: 51.65324942604166
    - type: nauc_ndcg_at_1000_max
      value: 29.729210561748797
    - type: nauc_ndcg_at_1000_std
      value: -8.830858681742994
    - type: nauc_ndcg_at_100_diff1
      value: 50.40059292035861
    - type: nauc_ndcg_at_100_max
      value: 29.323797091488856
    - type: nauc_ndcg_at_100_std
      value: -8.288820123602129
    - type: nauc_ndcg_at_10_diff1
      value: 47.73985149996194
    - type: nauc_ndcg_at_10_max
      value: 28.43547785458384
    - type: nauc_ndcg_at_10_std
      value: -7.355960453195441
    - type: nauc_ndcg_at_1_diff1
      value: 74.52821692195837
    - type: nauc_ndcg_at_1_max
      value: 32.2133212833154
    - type: nauc_ndcg_at_1_std
      value: -18.97663485312286
    - type: nauc_ndcg_at_20_diff1
      value: 48.34744447531361
    - type: nauc_ndcg_at_20_max
      value: 29.147274611665104
    - type: nauc_ndcg_at_20_std
      value: -7.1859909752874565
    - type: nauc_ndcg_at_3_diff1
      value: 48.02902219011437
    - type: nauc_ndcg_at_3_max
      value: 29.05519326030459
    - type: nauc_ndcg_at_3_std
      value: -9.562414651448368
    - type: nauc_ndcg_at_5_diff1
      value: 47.29981191574703
    - type: nauc_ndcg_at_5_max
      value: 28.014651730307428
    - type: nauc_ndcg_at_5_std
      value: -8.661224447638219
    - type: nauc_precision_at_1000_diff1
      value: -10.024865744474184
    - type: nauc_precision_at_1000_max
      value: -4.298508017924518
    - type: nauc_precision_at_1000_std
      value: 1.547025732357951
    - type: nauc_precision_at_100_diff1
      value: -12.06926468256376
    - type: nauc_precision_at_100_max
      value: -4.21291413804896
    - type: nauc_precision_at_100_std
      value: 2.872264631517362
    - type: nauc_precision_at_10_diff1
      value: -15.94007852972694
    - type: nauc_precision_at_10_max
      value: -4.544097710963198
    - type: nauc_precision_at_10_std
      value: 4.767828958024675
    - type: nauc_precision_at_1_diff1
      value: 74.52821692195837
    - type: nauc_precision_at_1_max
      value: 32.2133212833154
    - type: nauc_precision_at_1_std
      value: -18.97663485312286
    - type: nauc_precision_at_20_diff1
      value: -15.66405220649896
    - type: nauc_precision_at_20_max
      value: -3.6496367951851822
    - type: nauc_precision_at_20_std
      value: 4.825301805130045
    - type: nauc_precision_at_3_diff1
      value: -12.514109763479336
    - type: nauc_precision_at_3_max
      value: -0.24447133318217024
    - type: nauc_precision_at_3_std
      value: -0.2649163459628502
    - type: nauc_precision_at_5_diff1
      value: -15.820728575356485
    - type: nauc_precision_at_5_max
      value: -4.786371094249761
    - type: nauc_precision_at_5_std
      value: 1.7929947640996053
    - type: nauc_recall_at_1000_diff1
      value: 5.499530852392676
    - type: nauc_recall_at_1000_max
      value: 44.030520852910406
    - type: nauc_recall_at_1000_std
      value: 50.2017454712542
    - type: nauc_recall_at_100_diff1
      value: 2.0640091010830526
    - type: nauc_recall_at_100_max
      value: 24.864404635675204
    - type: nauc_recall_at_100_std
      value: 27.319350569429734
    - type: nauc_recall_at_10_diff1
      value: 13.791800250368114
    - type: nauc_recall_at_10_max
      value: 24.769825741582302
    - type: nauc_recall_at_10_std
      value: 13.59069444609498
    - type: nauc_recall_at_1_diff1
      value: 54.62356861092832
    - type: nauc_recall_at_1_max
      value: 25.79991281991449
    - type: nauc_recall_at_1_std
      value: -10.727885287362989
    - type: nauc_recall_at_20_diff1
      value: 5.336705306013041
    - type: nauc_recall_at_20_max
      value: 27.41570703746024
    - type: nauc_recall_at_20_std
      value: 23.006970266201787
    - type: nauc_recall_at_3_diff1
      value: 23.292169395266264
    - type: nauc_recall_at_3_max
      value: 24.262360079531074
    - type: nauc_recall_at_3_std
      value: -1.7422845002974312
    - type: nauc_recall_at_5_diff1
      value: 18.060917420579997
    - type: nauc_recall_at_5_max
      value: 23.06733097213354
    - type: nauc_recall_at_5_std
      value: 3.3913875084148297
    - type: ndcg_at_1
      value: 90.609
    - type: ndcg_at_10
      value: 93.147
    - type: ndcg_at_100
      value: 93.74900000000001
    - type: ndcg_at_1000
      value: 93.901
    - type: ndcg_at_20
      value: 93.447
    - type: ndcg_at_3
      value: 92.268
    - type: ndcg_at_5
      value: 92.757
    - type: precision_at_1
      value: 90.609
    - type: precision_at_10
      value: 10.926
    - type: precision_at_100
      value: 1.149
    - type: precision_at_1000
      value: 0.11800000000000001
    - type: precision_at_20
      value: 5.5809999999999995
    - type: precision_at_3
      value: 34.738
    - type: precision_at_5
      value: 21.346999999999998
    - type: recall_at_1
      value: 84.123
    - type: recall_at_10
      value: 96.539
    - type: recall_at_100
      value: 98.67899999999999
    - type: recall_at_1000
      value: 99.555
    - type: recall_at_20
      value: 97.45700000000001
    - type: recall_at_3
      value: 94.133
    - type: recall_at_5
      value: 95.44200000000001
  - task:
      type: Retrieval
    dataset:
      name: MTEB FiQA2018
      type: mteb/fiqa
      config: default
      split: test
      revision: 27a168819829fe9bcd655c2df245fb19452e8e06
    metrics:
    - type: main_score
      value: 61.182
    - type: map_at_1
      value: 31.877
    - type: map_at_10
      value: 52.986
    - type: map_at_100
      value: 55.242000000000004
    - type: map_at_1000
      value: 55.336
    - type: map_at_20
      value: 54.36299999999999
    - type: map_at_3
      value: 45.9
    - type: map_at_5
      value: 49.952000000000005
    - type: mrr_at_1
      value: 60.18518518518518
    - type: mrr_at_10
      value: 67.71611062120319
    - type: mrr_at_100
      value: 68.32957545203445
    - type: mrr_at_1000
      value: 68.34041293981731
    - type: mrr_at_20
      value: 68.1184684086802
    - type: mrr_at_3
      value: 66.04938271604934
    - type: mrr_at_5
      value: 67.02932098765427
    - type: nauc_map_at_1000_diff1
      value: 49.390058112037565
    - type: nauc_map_at_1000_max
      value: 33.86672922230126
    - type: nauc_map_at_1000_std
      value: -24.19297282790569
    - type: nauc_map_at_100_diff1
      value: 49.39575568085033
    - type: nauc_map_at_100_max
      value: 33.82800761671263
    - type: nauc_map_at_100_std
      value: -24.20216911890828
    - type: nauc_map_at_10_diff1
      value: 49.826703829159065
    - type: nauc_map_at_10_max
      value: 32.04132357301985
    - type: nauc_map_at_10_std
      value: -25.477594030350414
    - type: nauc_map_at_1_diff1
      value: 54.95925350681827
    - type: nauc_map_at_1_max
      value: 13.962825942647214
    - type: nauc_map_at_1_std
      value: -21.054092920927694
    - type: nauc_map_at_20_diff1
      value: 49.537681600887865
    - type: nauc_map_at_20_max
      value: 33.164569894845904
    - type: nauc_map_at_20_std
      value: -25.075136372458108
    - type: nauc_map_at_3_diff1
      value: 49.82581713716135
    - type: nauc_map_at_3_max
      value: 25.491261673133316
    - type: nauc_map_at_3_std
      value: -25.29735314206127
    - type: nauc_map_at_5_diff1
      value: 49.170865024768574
    - type: nauc_map_at_5_max
      value: 29.496572465872678
    - type: nauc_map_at_5_std
      value: -25.457134089214883
    - type: nauc_mrr_at_1000_diff1
      value: 59.44493769316621
    - type: nauc_mrr_at_1000_max
      value: 46.13272263925939
    - type: nauc_mrr_at_1000_std
      value: -19.11475143331668
    - type: nauc_mrr_at_100_diff1
      value: 59.44411441499269
    - type: nauc_mrr_at_100_max
      value: 46.13654028161708
    - type: nauc_mrr_at_100_std
      value: -19.109369325106417
    - type: nauc_mrr_at_10_diff1
      value: 59.219349927774154
    - type: nauc_mrr_at_10_max
      value: 46.02618026578592
    - type: nauc_mrr_at_10_std
      value: -19.37433068502548
    - type: nauc_mrr_at_1_diff1
      value: 62.95921038561675
    - type: nauc_mrr_at_1_max
      value: 46.18080967355503
    - type: nauc_mrr_at_1_std
      value: -18.40186184012292
    - type: nauc_mrr_at_20_diff1
      value: 59.3891382507084
    - type: nauc_mrr_at_20_max
      value: 46.044401310035894
    - type: nauc_mrr_at_20_std
      value: -19.257461333372504
    - type: nauc_mrr_at_3_diff1
      value: 59.238553596931
    - type: nauc_mrr_at_3_max
      value: 46.56487351573117
    - type: nauc_mrr_at_3_std
      value: -19.12741537508225
    - type: nauc_mrr_at_5_diff1
      value: 58.93737610599986
    - type: nauc_mrr_at_5_max
      value: 45.99436971500825
    - type: nauc_mrr_at_5_std
      value: -19.261662406716308
    - type: nauc_ndcg_at_1000_diff1
      value: 51.40360288706063
    - type: nauc_ndcg_at_1000_max
      value: 39.32722737004307
    - type: nauc_ndcg_at_1000_std
      value: -20.898685807989388
    - type: nauc_ndcg_at_100_diff1
      value: 51.36301353290372
    - type: nauc_ndcg_at_100_max
      value: 38.97243548753853
    - type: nauc_ndcg_at_100_std
      value: -20.50022060973278
    - type: nauc_ndcg_at_10_diff1
      value: 51.44403959729833
    - type: nauc_ndcg_at_10_max
      value: 36.01289481113504
    - type: nauc_ndcg_at_10_std
      value: -24.176498000068843
    - type: nauc_ndcg_at_1_diff1
      value: 62.95921038561675
    - type: nauc_ndcg_at_1_max
      value: 46.18080967355503
    - type: nauc_ndcg_at_1_std
      value: -18.40186184012292
    - type: nauc_ndcg_at_20_diff1
      value: 51.41066012197159
    - type: nauc_ndcg_at_20_max
      value: 37.24872539687912
    - type: nauc_ndcg_at_20_std
      value: -23.372189423803118
    - type: nauc_ndcg_at_3_diff1
      value: 48.489628982965854
    - type: nauc_ndcg_at_3_max
      value: 36.93242010543425
    - type: nauc_ndcg_at_3_std
      value: -23.566283895234708
    - type: nauc_ndcg_at_5_diff1
      value: 48.855011049758616
    - type: nauc_ndcg_at_5_max
      value: 34.72552703254509
    - type: nauc_ndcg_at_5_std
      value: -24.603662195056884
    - type: nauc_precision_at_1000_diff1
      value: -16.254896831329358
    - type: nauc_precision_at_1000_max
      value: 26.68880233255314
    - type: nauc_precision_at_1000_std
      value: 15.711021613094275
    - type: nauc_precision_at_100_diff1
      value: -11.963143494271204
    - type: nauc_precision_at_100_max
      value: 30.662204917415004
    - type: nauc_precision_at_100_std
      value: 15.037733765190636
    - type: nauc_precision_at_10_diff1
      value: 4.189692935472799
    - type: nauc_precision_at_10_max
      value: 37.378105954795075
    - type: nauc_precision_at_10_std
      value: -1.0086179584149657
    - type: nauc_precision_at_1_diff1
      value: 62.95921038561675
    - type: nauc_precision_at_1_max
      value: 46.18080967355503
    - type: nauc_precision_at_1_std
      value: -18.40186184012292
    - type: nauc_precision_at_20_diff1
      value: -3.1588007120578276
    - type: nauc_precision_at_20_max
      value: 35.380893467283215
    - type: nauc_precision_at_20_std
      value: 4.992120324159972
    - type: nauc_precision_at_3_diff1
      value: 18.37633057040911
    - type: nauc_precision_at_3_max
      value: 42.06004715153175
    - type: nauc_precision_at_3_std
      value: -11.214136554742755
    - type: nauc_precision_at_5_diff1
      value: 10.224008279551054
    - type: nauc_precision_at_5_max
      value: 40.18017184406908
    - type: nauc_precision_at_5_std
      value: -7.103870184792855
    - type: nauc_recall_at_1000_diff1
      value: 38.30826137726082
    - type: nauc_recall_at_1000_max
      value: 37.17044147876854
    - type: nauc_recall_at_1000_std
      value: 10.594199798446793
    - type: nauc_recall_at_100_diff1
      value: 40.454335943748475
    - type: nauc_recall_at_100_max
      value: 31.170902337200097
    - type: nauc_recall_at_100_std
      value: -0.8492074860948018
    - type: nauc_recall_at_10_diff1
      value: 44.954194528652735
    - type: nauc_recall_at_10_max
      value: 28.27547239551631
    - type: nauc_recall_at_10_std
      value: -24.747605039280685
    - type: nauc_recall_at_1_diff1
      value: 54.95925350681827
    - type: nauc_recall_at_1_max
      value: 13.962825942647214
    - type: nauc_recall_at_1_std
      value: -21.054092920927694
    - type: nauc_recall_at_20_diff1
      value: 44.398293084195636
    - type: nauc_recall_at_20_max
      value: 29.604081242804735
    - type: nauc_recall_at_20_std
      value: -22.90399779981129
    - type: nauc_recall_at_3_diff1
      value: 43.25687263417001
    - type: nauc_recall_at_3_max
      value: 20.50817103562355
    - type: nauc_recall_at_3_std
      value: -26.567575668398508
    - type: nauc_recall_at_5_diff1
      value: 40.81840199310296
    - type: nauc_recall_at_5_max
      value: 23.1238715032068
    - type: nauc_recall_at_5_std
      value: -25.64446934619821
    - type: ndcg_at_1
      value: 60.185
    - type: ndcg_at_10
      value: 61.182
    - type: ndcg_at_100
      value: 67.523
    - type: ndcg_at_1000
      value: 68.759
    - type: ndcg_at_20
      value: 64.084
    - type: ndcg_at_3
      value: 56.48
    - type: ndcg_at_5
      value: 58.098000000000006
    - type: precision_at_1
      value: 60.185
    - type: precision_at_10
      value: 17.083000000000002
    - type: precision_at_100
      value: 2.366
    - type: precision_at_1000
      value: 0.259
    - type: precision_at_20
      value: 9.884
    - type: precision_at_3
      value: 37.757000000000005
    - type: precision_at_5
      value: 27.747
    - type: recall_at_1
      value: 31.877
    - type: recall_at_10
      value: 68.868
    - type: recall_at_100
      value: 91.26100000000001
    - type: recall_at_1000
      value: 98.346
    - type: recall_at_20
      value: 77.523
    - type: recall_at_3
      value: 51.226000000000006
    - type: recall_at_5
      value: 59.319
  - task:
      type: Retrieval
    dataset:
      name: MTEB HotpotQA
      type: mteb/hotpotqa
      config: default
      split: test
      revision: ab518f4d6fcca38d87c25209f94beba119d02014
    metrics:
    - type: main_score
      value: 79.125
    - type: map_at_1
      value: 43.72
    - type: map_at_10
      value: 72.03500000000001
    - type: map_at_100
      value: 72.761
    - type: map_at_1000
      value: 72.80499999999999
    - type: map_at_20
      value: 72.477
    - type: map_at_3
      value: 68.84700000000001
    - type: map_at_5
      value: 70.982
    - type: mrr_at_1
      value: 87.44091829844699
    - type: mrr_at_10
      value: 91.31576155107534
    - type: mrr_at_100
      value: 91.40489558470692
    - type: mrr_at_1000
      value: 91.40687231624047
    - type: mrr_at_20
      value: 91.37223203223267
    - type: mrr_at_3
      value: 90.84177357641214
    - type: mrr_at_5
      value: 91.17938329957211
    - type: nauc_map_at_1000_diff1
      value: 2.160941678109871
    - type: nauc_map_at_1000_max
      value: 20.280335959707244
    - type: nauc_map_at_1000_std
      value: 2.097428882568907
    - type: nauc_map_at_100_diff1
      value: 2.1230954064310272
    - type: nauc_map_at_100_max
      value: 20.258093599808014
    - type: nauc_map_at_100_std
      value: 2.1151474260126633
    - type: nauc_map_at_10_diff1
      value: 1.8723430508681238
    - type: nauc_map_at_10_max
      value: 20.001115713122292
    - type: nauc_map_at_10_std
      value: 1.5120467206405304
    - type: nauc_map_at_1_diff1
      value: 68.47218714216126
    - type: nauc_map_at_1_max
      value: 48.79030836492533
    - type: nauc_map_at_1_std
      value: -14.325167455523276
    - type: nauc_map_at_20_diff1
      value: 2.021495128391111
    - type: nauc_map_at_20_max
      value: 20.19494185197473
    - type: nauc_map_at_20_std
      value: 1.988283622854646
    - type: nauc_map_at_3_diff1
      value: 1.3035766010655014
    - type: nauc_map_at_3_max
      value: 18.267934028448014
    - type: nauc_map_at_3_std
      value: -1.5393823883989837
    - type: nauc_map_at_5_diff1
      value: 1.6758465601660635
    - type: nauc_map_at_5_max
      value: 19.611409174084766
    - type: nauc_map_at_5_std
      value: 0.5379733914867968
    - type: nauc_mrr_at_1000_diff1
      value: 68.60925278528931
    - type: nauc_mrr_at_1000_max
      value: 53.41174729989386
    - type: nauc_mrr_at_1000_std
      value: -10.94381937854199
    - type: nauc_mrr_at_100_diff1
      value: 68.61192764944234
    - type: nauc_mrr_at_100_max
      value: 53.41979323473436
    - type: nauc_mrr_at_100_std
      value: -10.928418937183535
    - type: nauc_mrr_at_10_diff1
      value: 68.58075465200439
    - type: nauc_mrr_at_10_max
      value: 53.469248695058894
    - type: nauc_mrr_at_10_std
      value: -11.033247242342176
    - type: nauc_mrr_at_1_diff1
      value: 68.47218714216126
    - type: nauc_mrr_at_1_max
      value: 48.79030836492533
    - type: nauc_mrr_at_1_std
      value: -14.325167455523276
    - type: nauc_mrr_at_20_diff1
      value: 68.61440353772745
    - type: nauc_mrr_at_20_max
      value: 53.48475026827637
    - type: nauc_mrr_at_20_std
      value: -10.890302904034154
    - type: nauc_mrr_at_3_diff1
      value: 68.69282004791216
    - type: nauc_mrr_at_3_max
      value: 54.06094833361629
    - type: nauc_mrr_at_3_std
      value: -11.153009129882598
    - type: nauc_mrr_at_5_diff1
      value: 68.73035503749831
    - type: nauc_mrr_at_5_max
      value: 53.83508048703245
    - type: nauc_mrr_at_5_std
      value: -11.003690030416173
    - type: nauc_ndcg_at_1000_diff1
      value: 9.50087869973644
    - type: nauc_ndcg_at_1000_max
      value: 25.950105183418927
    - type: nauc_ndcg_at_1000_std
      value: 5.135066113356472
    - type: nauc_ndcg_at_100_diff1
      value: 8.362935638818364
    - type: nauc_ndcg_at_100_max
      value: 25.34061127640931
    - type: nauc_ndcg_at_100_std
      value: 5.754839950507415
    - type: nauc_ndcg_at_10_diff1
      value: 7.156928707580207
    - type: nauc_ndcg_at_10_max
      value: 24.251874180080023
    - type: nauc_ndcg_at_10_std
      value: 3.4311673728584373
    - type: nauc_ndcg_at_1_diff1
      value: 68.47218714216126
    - type: nauc_ndcg_at_1_max
      value: 48.79030836492533
    - type: nauc_ndcg_at_1_std
      value: -14.325167455523276
    - type: nauc_ndcg_at_20_diff1
      value: 7.631421824536802
    - type: nauc_ndcg_at_20_max
      value: 24.899012298150367
    - type: nauc_ndcg_at_20_std
      value: 5.015727485279167
    - type: nauc_ndcg_at_3_diff1
      value: 6.765698105055132
    - type: nauc_ndcg_at_3_max
      value: 22.068064891465696
    - type: nauc_ndcg_at_3_std
      value: -1.4664522141695102
    - type: nauc_ndcg_at_5_diff1
      value: 6.97155171194824
    - type: nauc_ndcg_at_5_max
      value: 23.660849668507527
    - type: nauc_ndcg_at_5_std
      value: 1.4707432249488543
    - type: nauc_precision_at_1000_diff1
      value: -5.507220131591544
    - type: nauc_precision_at_1000_max
      value: 35.494019207652336
    - type: nauc_precision_at_1000_std
      value: 51.48431882469268
    - type: nauc_precision_at_100_diff1
      value: -9.856655267678178
    - type: nauc_precision_at_100_max
      value: 23.40730506252858
    - type: nauc_precision_at_100_std
      value: 34.01534710435972
    - type: nauc_precision_at_10_diff1
      value: -7.169347416977972
    - type: nauc_precision_at_10_max
      value: 20.252826543847206
    - type: nauc_precision_at_10_std
      value: 13.940728560252206
    - type: nauc_precision_at_1_diff1
      value: 68.47218714216126
    - type: nauc_precision_at_1_max
      value: 48.79030836492533
    - type: nauc_precision_at_1_std
      value: -14.325167455523276
    - type: nauc_precision_at_20_diff1
      value: -7.783356154578335
    - type: nauc_precision_at_20_max
      value: 21.74000065585772
    - type: nauc_precision_at_20_std
      value: 21.489921794963333
    - type: nauc_precision_at_3_diff1
      value: -4.4855992702233385
    - type: nauc_precision_at_3_max
      value: 17.58424070747094
    - type: nauc_precision_at_3_std
      value: 1.8777336548123371
    - type: nauc_precision_at_5_diff1
      value: -5.604031655005792
    - type: nauc_precision_at_5_max
      value: 19.580893429923517
    - type: nauc_precision_at_5_std
      value: 7.8203617045788505
    - type: nauc_recall_at_1000_diff1
      value: -5.507220131591377
    - type: nauc_recall_at_1000_max
      value: 35.494019207652414
    - type: nauc_recall_at_1000_std
      value: 51.48431882469249
    - type: nauc_recall_at_100_diff1
      value: -9.856655267678182
    - type: nauc_recall_at_100_max
      value: 23.407305062528323
    - type: nauc_recall_at_100_std
      value: 34.01534710435951
    - type: nauc_recall_at_10_diff1
      value: -7.169347416977698
    - type: nauc_recall_at_10_max
      value: 20.252826543847338
    - type: nauc_recall_at_10_std
      value: 13.940728560252335
    - type: nauc_recall_at_1_diff1
      value: 68.47218714216126
    - type: nauc_recall_at_1_max
      value: 48.79030836492533
    - type: nauc_recall_at_1_std
      value: -14.325167455523276
    - type: nauc_recall_at_20_diff1
      value: -7.7833561545783985
    - type: nauc_recall_at_20_max
      value: 21.740000655857713
    - type: nauc_recall_at_20_std
      value: 21.489921794963426
    - type: nauc_recall_at_3_diff1
      value: -4.485599270223427
    - type: nauc_recall_at_3_max
      value: 17.584240707470887
    - type: nauc_recall_at_3_std
      value: 1.8777336548121935
    - type: nauc_recall_at_5_diff1
      value: -5.604031655005744
    - type: nauc_recall_at_5_max
      value: 19.580893429923695
    - type: nauc_recall_at_5_std
      value: 7.820361704579018
    - type: ndcg_at_1
      value: 87.441
    - type: ndcg_at_10
      value: 79.125
    - type: ndcg_at_100
      value: 81.45400000000001
    - type: ndcg_at_1000
      value: 82.25099999999999
    - type: ndcg_at_20
      value: 80.17
    - type: ndcg_at_3
      value: 74.956
    - type: ndcg_at_5
      value: 77.48
    - type: precision_at_1
      value: 87.441
    - type: precision_at_10
      value: 16.323999999999998
    - type: precision_at_100
      value: 1.8110000000000002
    - type: precision_at_1000
      value: 0.192
    - type: precision_at_20
      value: 8.498
    - type: precision_at_3
      value: 48.368
    - type: precision_at_5
      value: 31.002999999999997
    - type: recall_at_1
      value: 43.72
    - type: recall_at_10
      value: 81.621
    - type: recall_at_100
      value: 90.554
    - type: recall_at_1000
      value: 95.787
    - type: recall_at_20
      value: 84.983
    - type: recall_at_3
      value: 72.552
    - type: recall_at_5
      value: 77.508
  - task:
      type: Retrieval
    dataset:
      name: MTEB MSMARCO
      type: mteb/msmarco
      config: default
      split: dev
      revision: c5a29a104738b98a9e76336939199e264163d4a0
    metrics:
    - type: main_score
      value: 44.89
    - type: map_at_1
      value: 24.432000000000002
    - type: map_at_10
      value: 37.591
    - type: map_at_100
      value: 38.751000000000005
    - type: map_at_1000
      value: 38.79
    - type: map_at_20
      value: 38.322
    - type: map_at_3
      value: 33.505
    - type: map_at_5
      value: 35.859
    - type: mrr_at_1
      value: 25.171919770773638
    - type: mrr_at_10
      value: 38.21256310547136
    - type: mrr_at_100
      value: 39.30753721884505
    - type: mrr_at_1000
      value: 39.340691344391445
    - type: mrr_at_20
      value: 38.90961306475649
    - type: mrr_at_3
      value: 34.26456542502386
    - type: mrr_at_5
      value: 36.53748806112701
    - type: nauc_map_at_1000_diff1
      value: 38.66852221567241
    - type: nauc_map_at_1000_max
      value: 4.1057766737799595
    - type: nauc_map_at_1000_std
      value: -27.382157855077754
    - type: nauc_map_at_100_diff1
      value: 38.6621397928445
    - type: nauc_map_at_100_max
      value: 4.111681335095865
    - type: nauc_map_at_100_std
      value: -27.36539945792605
    - type: nauc_map_at_10_diff1
      value: 38.63319989433825
    - type: nauc_map_at_10_max
      value: 3.9346979349074953
    - type: nauc_map_at_10_std
      value: -28.0900393767871
    - type: nauc_map_at_1_diff1
      value: 41.71535844577686
    - type: nauc_map_at_1_max
      value: 3.4832962062214006
    - type: nauc_map_at_1_std
      value: -23.525528000333843
    - type: nauc_map_at_20_diff1
      value: 38.68062082411943
    - type: nauc_map_at_20_max
      value: 4.046538867480454
    - type: nauc_map_at_20_std
      value: -27.688449948610472
    - type: nauc_map_at_3_diff1
      value: 38.584342089335685
    - type: nauc_map_at_3_max
      value: 3.63965785769002
    - type: nauc_map_at_3_std
      value: -27.46268496496546
    - type: nauc_map_at_5_diff1
      value: 38.42816219182273
    - type: nauc_map_at_5_max
      value: 3.839849854247509
    - type: nauc_map_at_5_std
      value: -28.015487623173605
    - type: nauc_mrr_at_1000_diff1
      value: 38.232755814715766
    - type: nauc_mrr_at_1000_max
      value: 3.987692507096141
    - type: nauc_mrr_at_1000_std
      value: -26.888695263011808
    - type: nauc_mrr_at_100_diff1
      value: 38.22616005576646
    - type: nauc_mrr_at_100_max
      value: 3.9948619556899123
    - type: nauc_mrr_at_100_std
      value: -26.872832670267883
    - type: nauc_mrr_at_10_diff1
      value: 38.155508621490306
    - type: nauc_mrr_at_10_max
      value: 3.8153177084303582
    - type: nauc_mrr_at_10_std
      value: -27.546238510006503
    - type: nauc_mrr_at_1_diff1
      value: 41.26563649433227
    - type: nauc_mrr_at_1_max
      value: 3.2940832364845734
    - type: nauc_mrr_at_1_std
      value: -23.246326699010055
    - type: nauc_mrr_at_20_diff1
      value: 38.23581610598243
    - type: nauc_mrr_at_20_max
      value: 3.9519434237902455
    - type: nauc_mrr_at_20_std
      value: -27.153182984955542
    - type: nauc_mrr_at_3_diff1
      value: 38.123012505586516
    - type: nauc_mrr_at_3_max
      value: 3.5952793301902446
    - type: nauc_mrr_at_3_std
      value: -26.96557107215608
    - type: nauc_mrr_at_5_diff1
      value: 38.00080442994164
    - type: nauc_mrr_at_5_max
      value: 3.6611507063907838
    - type: nauc_mrr_at_5_std
      value: -27.5217700193094
    - type: nauc_ndcg_at_1000_diff1
      value: 38.08376371232426
    - type: nauc_ndcg_at_1000_max
      value: 4.741285538467179
    - type: nauc_ndcg_at_1000_std
      value: -26.876920597404325
    - type: nauc_ndcg_at_100_diff1
      value: 37.933209786580186
    - type: nauc_ndcg_at_100_max
      value: 5.003377252588231
    - type: nauc_ndcg_at_100_std
      value: -26.136134328732467
    - type: nauc_ndcg_at_10_diff1
      value: 37.82072609591181
    - type: nauc_ndcg_at_10_max
      value: 4.24748877233556
    - type: nauc_ndcg_at_10_std
      value: -29.766127219449835
    - type: nauc_ndcg_at_1_diff1
      value: 41.26563649433227
    - type: nauc_ndcg_at_1_max
      value: 3.2940832364845734
    - type: nauc_ndcg_at_1_std
      value: -23.246326699010055
    - type: nauc_ndcg_at_20_diff1
      value: 38.068479496194165
    - type: nauc_ndcg_at_20_max
      value: 4.686171701536077
    - type: nauc_ndcg_at_20_std
      value: -28.373083045837827
    - type: nauc_ndcg_at_3_diff1
      value: 37.664591050650714
    - type: nauc_ndcg_at_3_max
      value: 3.7238056730982425
    - type: nauc_ndcg_at_3_std
      value: -28.501705219533402
    - type: nauc_ndcg_at_5_diff1
      value: 37.39323161347562
    - type: nauc_ndcg_at_5_max
      value: 3.9884773576701846
    - type: nauc_ndcg_at_5_std
      value: -29.526098685579278
    - type: nauc_precision_at_1000_diff1
      value: -8.176278274893253
    - type: nauc_precision_at_1000_max
      value: 6.602206468153366
    - type: nauc_precision_at_1000_std
      value: 11.887969321516541
    - type: nauc_precision_at_100_diff1
      value: 10.776600450291125
    - type: nauc_precision_at_100_max
      value: 11.543791706232499
    - type: nauc_precision_at_100_std
      value: 8.05135325335674
    - type: nauc_precision_at_10_diff1
      value: 31.29891891655396
    - type: nauc_precision_at_10_max
      value: 4.793824130342508
    - type: nauc_precision_at_10_std
      value: -32.843126960584904
    - type: nauc_precision_at_1_diff1
      value: 41.26563649433227
    - type: nauc_precision_at_1_max
      value: 3.2940832364845734
    - type: nauc_precision_at_1_std
      value: -23.246326699010055
    - type: nauc_precision_at_20_diff1
      value: 28.39742040356656
    - type: nauc_precision_at_20_max
      value: 6.848015766561338
    - type: nauc_precision_at_20_std
      value: -24.61307381544946
    - type: nauc_precision_at_3_diff1
      value: 34.1967778945159
    - type: nauc_precision_at_3_max
      value: 3.6373839227371354
    - type: nauc_precision_at_3_std
      value: -31.262400131015795
    - type: nauc_precision_at_5_diff1
      value: 32.32839846166563
    - type: nauc_precision_at_5_max
      value: 4.2661314616361885
    - type: nauc_precision_at_5_std
      value: -32.94817957117079
    - type: nauc_recall_at_1000_diff1
      value: 25.124054710942882
    - type: nauc_recall_at_1000_max
      value: 52.99541699631579
    - type: nauc_recall_at_1000_std
      value: 63.880015110366394
    - type: nauc_recall_at_100_diff1
      value: 32.1323577870331
    - type: nauc_recall_at_100_max
      value: 17.26171631192854
    - type: nauc_recall_at_100_std
      value: 4.147658345720864
    - type: nauc_recall_at_10_diff1
      value: 35.35982089295331
    - type: nauc_recall_at_10_max
      value: 5.478913284596572
    - type: nauc_recall_at_10_std
      value: -35.93639290916612
    - type: nauc_recall_at_1_diff1
      value: 41.71535844577686
    - type: nauc_recall_at_1_max
      value: 3.4832962062214006
    - type: nauc_recall_at_1_std
      value: -23.525528000333843
    - type: nauc_recall_at_20_diff1
      value: 36.36549599422767
    - type: nauc_recall_at_20_max
      value: 8.112692947664327
    - type: nauc_recall_at_20_std
      value: -30.573957801286095
    - type: nauc_recall_at_3_diff1
      value: 35.227199657140844
    - type: nauc_recall_at_3_max
      value: 3.9474392083855445
    - type: nauc_recall_at_3_std
      value: -31.485135190684904
    - type: nauc_recall_at_5_diff1
      value: 34.435115639178505
    - type: nauc_recall_at_5_max
      value: 4.538709973891948
    - type: nauc_recall_at_5_std
      value: -34.07440191001999
    - type: ndcg_at_1
      value: 25.172
    - type: ndcg_at_10
      value: 44.89
    - type: ndcg_at_100
      value: 50.33800000000001
    - type: ndcg_at_1000
      value: 51.266999999999996
    - type: ndcg_at_20
      value: 47.455999999999996
    - type: ndcg_at_3
      value: 36.631
    - type: ndcg_at_5
      value: 40.801
    - type: precision_at_1
      value: 25.172
    - type: precision_at_10
      value: 7.0489999999999995
    - type: precision_at_100
      value: 0.976
    - type: precision_at_1000
      value: 0.106
    - type: precision_at_20
      value: 4.059
    - type: precision_at_3
      value: 15.554000000000002
    - type: precision_at_5
      value: 11.458
    - type: recall_at_1
      value: 24.432000000000002
    - type: recall_at_10
      value: 67.32900000000001
    - type: recall_at_100
      value: 92.23599999999999
    - type: recall_at_1000
      value: 99.21799999999999
    - type: recall_at_20
      value: 77.236
    - type: recall_at_3
      value: 44.926
    - type: recall_at_5
      value: 54.93599999999999
  - task:
      type: Retrieval
    dataset:
      name: MTEB NFCorpus
      type: mteb/nfcorpus
      config: default
      split: test
      revision: ec0fa4fe99da2ff19ca1214b7966684033a58814
    metrics:
    - type: main_score
      value: 45.059
    - type: map_at_1
      value: 7.51
    - type: map_at_10
      value: 17.696
    - type: map_at_100
      value: 23.425
    - type: map_at_1000
      value: 25.462
    - type: map_at_20
      value: 20.078
    - type: map_at_3
      value: 12.36
    - type: map_at_5
      value: 14.949000000000002
    - type: mrr_at_1
      value: 56.656346749226
    - type: mrr_at_10
      value: 64.5453093518109
    - type: mrr_at_100
      value: 65.03548614941461
    - type: mrr_at_1000
      value: 65.07113760571535
    - type: mrr_at_20
      value: 64.92649519989713
    - type: mrr_at_3
      value: 62.5902992776058
    - type: mrr_at_5
      value: 63.890608875129
    - type: nauc_map_at_1000_diff1
      value: 18.649436695375666
    - type: nauc_map_at_1000_max
      value: 32.21371026469436
    - type: nauc_map_at_1000_std
      value: 15.172576825419542
    - type: nauc_map_at_100_diff1
      value: 20.754932725250484
    - type: nauc_map_at_100_max
      value: 31.802273361479354
    - type: nauc_map_at_100_std
      value: 11.05184960109897
    - type: nauc_map_at_10_diff1
      value: 27.65114332743644
    - type: nauc_map_at_10_max
      value: 24.216308956707948
    - type: nauc_map_at_10_std
      value: -3.148160320265085
    - type: nauc_map_at_1_diff1
      value: 44.074701941156576
    - type: nauc_map_at_1_max
      value: 7.313976830684179
    - type: nauc_map_at_1_std
      value: -17.775136864794273
    - type: nauc_map_at_20_diff1
      value: 24.40381389925362
    - type: nauc_map_at_20_max
      value: 28.28590842979618
    - type: nauc_map_at_20_std
      value: 2.4199688163030033
    - type: nauc_map_at_3_diff1
      value: 36.43847181675257
    - type: nauc_map_at_3_max
      value: 12.641525583061982
    - type: nauc_map_at_3_std
      value: -13.213788837135754
    - type: nauc_map_at_5_diff1
      value: 31.38099882079377
    - type: nauc_map_at_5_max
      value: 18.693157001709874
    - type: nauc_map_at_5_std
      value: -9.06791377198616
    - type: nauc_mrr_at_1000_diff1
      value: 32.13397852247498
    - type: nauc_mrr_at_1000_max
      value: 50.13330116214628
    - type: nauc_mrr_at_1000_std
      value: 32.05378496757561
    - type: nauc_mrr_at_100_diff1
      value: 32.15640184504514
    - type: nauc_mrr_at_100_max
      value: 50.16596418746684
    - type: nauc_mrr_at_100_std
      value: 32.09654562666087
    - type: nauc_mrr_at_10_diff1
      value: 32.30697278515013
    - type: nauc_mrr_at_10_max
      value: 50.29554162816291
    - type: nauc_mrr_at_10_std
      value: 32.196301987204926
    - type: nauc_mrr_at_1_diff1
      value: 31.18633610462525
    - type: nauc_mrr_at_1_max
      value: 44.066192007922865
    - type: nauc_mrr_at_1_std
      value: 25.405697533712186
    - type: nauc_mrr_at_20_diff1
      value: 32.183918395170934
    - type: nauc_mrr_at_20_max
      value: 50.1063795003295
    - type: nauc_mrr_at_20_std
      value: 32.019605254607605
    - type: nauc_mrr_at_3_diff1
      value: 32.1841620866096
    - type: nauc_mrr_at_3_max
      value: 49.86413651460263
    - type: nauc_mrr_at_3_std
      value: 31.65393088251129
    - type: nauc_mrr_at_5_diff1
      value: 32.506293256782854
    - type: nauc_mrr_at_5_max
      value: 50.22051310167734
    - type: nauc_mrr_at_5_std
      value: 32.20883162067511
    - type: nauc_ndcg_at_1000_diff1
      value: 17.07651298169536
    - type: nauc_ndcg_at_1000_max
      value: 45.68207250664515
    - type: nauc_ndcg_at_1000_std
      value: 32.2202917954314
    - type: nauc_ndcg_at_100_diff1
      value: 17.903616207181084
    - type: nauc_ndcg_at_100_max
      value: 41.75926814949547
    - type: nauc_ndcg_at_100_std
      value: 28.203224194584394
    - type: nauc_ndcg_at_10_diff1
      value: 15.047796165484423
    - type: nauc_ndcg_at_10_max
      value: 42.932973260133025
    - type: nauc_ndcg_at_10_std
      value: 28.988863166538216
    - type: nauc_ndcg_at_1_diff1
      value: 31.424681423032517
    - type: nauc_ndcg_at_1_max
      value: 41.520899599635705
    - type: nauc_ndcg_at_1_std
      value: 25.06328981312087
    - type: nauc_ndcg_at_20_diff1
      value: 14.659965916220653
    - type: nauc_ndcg_at_20_max
      value: 40.660613171359536
    - type: nauc_ndcg_at_20_std
      value: 28.05980217396367
    - type: nauc_ndcg_at_3_diff1
      value: 20.74188837396788
    - type: nauc_ndcg_at_3_max
      value: 42.17291456152861
    - type: nauc_ndcg_at_3_std
      value: 25.51560749819014
    - type: nauc_ndcg_at_5_diff1
      value: 16.85211778345349
    - type: nauc_ndcg_at_5_max
      value: 43.984121150231836
    - type: nauc_ndcg_at_5_std
      value: 26.83926214905424
    - type: nauc_precision_at_1000_diff1
      value: -17.051131025174517
    - type: nauc_precision_at_1000_max
      value: 6.764059286595738
    - type: nauc_precision_at_1000_std
      value: 40.1439309994832
    - type: nauc_precision_at_100_diff1
      value: -15.764998544735823
    - type: nauc_precision_at_100_max
      value: 19.211111148845784
    - type: nauc_precision_at_100_std
      value: 46.96427473897526
    - type: nauc_precision_at_10_diff1
      value: -7.388798905334601
    - type: nauc_precision_at_10_max
      value: 41.22907941806041
    - type: nauc_precision_at_10_std
      value: 42.59884089023569
    - type: nauc_precision_at_1_diff1
      value: 32.025767729163995
    - type: nauc_precision_at_1_max
      value: 43.754075663448575
    - type: nauc_precision_at_1_std
      value: 25.43509133901274
    - type: nauc_precision_at_20_diff1
      value: -12.0078847232814
    - type: nauc_precision_at_20_max
      value: 33.27932495727302
    - type: nauc_precision_at_20_std
      value: 43.837569920515165
    - type: nauc_precision_at_3_diff1
      value: 7.042749712513677
    - type: nauc_precision_at_3_max
      value: 42.1936184896299
    - type: nauc_precision_at_3_std
      value: 30.484961204241984
    - type: nauc_precision_at_5_diff1
      value: -2.1371357099813832
    - type: nauc_precision_at_5_max
      value: 43.476640933633895
    - type: nauc_precision_at_5_std
      value: 35.117927839092914
    - type: nauc_recall_at_1000_diff1
      value: -0.8723013662864799
    - type: nauc_recall_at_1000_max
      value: 18.909026237682543
    - type: nauc_recall_at_1000_std
      value: 13.51570098053679
    - type: nauc_recall_at_100_diff1
      value: 12.357279426756397
    - type: nauc_recall_at_100_max
      value: 27.84208167172234
    - type: nauc_recall_at_100_std
      value: 14.49863872734005
    - type: nauc_recall_at_10_diff1
      value: 21.11009281729574
    - type: nauc_recall_at_10_max
      value: 19.74472802495254
    - type: nauc_recall_at_10_std
      value: -4.09630500503252
    - type: nauc_recall_at_1_diff1
      value: 44.074701941156576
    - type: nauc_recall_at_1_max
      value: 7.313976830684179
    - type: nauc_recall_at_1_std
      value: -17.775136864794273
    - type: nauc_recall_at_20_diff1
      value: 17.31518452608809
    - type: nauc_recall_at_20_max
      value: 23.399843692692237
    - type: nauc_recall_at_20_std
      value: 0.04814256658120452
    - type: nauc_recall_at_3_diff1
      value: 35.46183411619658
    - type: nauc_recall_at_3_max
      value: 12.787287273388953
    - type: nauc_recall_at_3_std
      value: -12.428077847406232
    - type: nauc_recall_at_5_diff1
      value: 25.630390779262065
    - type: nauc_recall_at_5_max
      value: 17.81997541214207
    - type: nauc_recall_at_5_std
      value: -7.819448998740632
    - type: ndcg_at_1
      value: 55.418
    - type: ndcg_at_10
      value: 45.059
    - type: ndcg_at_100
      value: 41.89
    - type: ndcg_at_1000
      value: 50.808
    - type: ndcg_at_20
      value: 42.528
    - type: ndcg_at_3
      value: 50.273999999999994
    - type: ndcg_at_5
      value: 48.311
    - type: precision_at_1
      value: 56.347
    - type: precision_at_10
      value: 33.684
    - type: precision_at_100
      value: 10.854
    - type: precision_at_1000
      value: 2.455
    - type: precision_at_20
      value: 25.294
    - type: precision_at_3
      value: 46.749
    - type: precision_at_5
      value: 42.167
    - type: recall_at_1
      value: 7.51
    - type: recall_at_10
      value: 22.7
    - type: recall_at_100
      value: 42.324
    - type: recall_at_1000
      value: 75.047
    - type: recall_at_20
      value: 28.091
    - type: recall_at_3
      value: 13.202
    - type: recall_at_5
      value: 17.573
  - task:
      type: Retrieval
    dataset:
      name: MTEB NQ
      type: mteb/nq
      config: default
      split: test
      revision: b774495ed302d8c44a3a7ea25c90dbce03968f31
    metrics:
    - type: main_score
      value: 72.439
    - type: map_at_1
      value: 48.588
    - type: map_at_10
      value: 65.667
    - type: map_at_100
      value: 66.23
    - type: map_at_1000
      value: 66.238
    - type: map_at_20
      value: 66.077
    - type: map_at_3
      value: 62.173
    - type: map_at_5
      value: 64.403
    - type: mrr_at_1
      value: 54.57705677867902
    - type: mrr_at_10
      value: 68.04977330831896
    - type: mrr_at_100
      value: 68.40133412359447
    - type: mrr_at_1000
      value: 68.40674582113029
    - type: mrr_at_20
      value: 68.32025711906769
    - type: mrr_at_3
      value: 65.68173039783692
    - type: mrr_at_5
      value: 67.12292390884501
    - type: nauc_map_at_1000_diff1
      value: 42.92613415901299
    - type: nauc_map_at_1000_max
      value: 31.58722964102006
    - type: nauc_map_at_1000_std
      value: -9.181430909023906
    - type: nauc_map_at_100_diff1
      value: 42.9286603531827
    - type: nauc_map_at_100_max
      value: 31.597761214322794
    - type: nauc_map_at_100_std
      value: -9.174864948929978
    - type: nauc_map_at_10_diff1
      value: 42.742103497799874
    - type: nauc_map_at_10_max
      value: 31.73600271519757
    - type: nauc_map_at_10_std
      value: -9.599976341144492
    - type: nauc_map_at_1_diff1
      value: 44.97465030457452
    - type: nauc_map_at_1_max
      value: 24.50842235041081
    - type: nauc_map_at_1_std
      value: -9.488301413929715
    - type: nauc_map_at_20_diff1
      value: 42.93789543281411
    - type: nauc_map_at_20_max
      value: 31.649530881844477
    - type: nauc_map_at_20_std
      value: -9.284482255074405
    - type: nauc_map_at_3_diff1
      value: 42.507020478710444
    - type: nauc_map_at_3_max
      value: 30.430161368656407
    - type: nauc_map_at_3_std
      value: -10.98022633967904
    - type: nauc_map_at_5_diff1
      value: 42.65908349342647
    - type: nauc_map_at_5_max
      value: 31.712314514485808
    - type: nauc_map_at_5_std
      value: -10.162495644166388
    - type: nauc_mrr_at_1000_diff1
      value: 43.07977164212382
    - type: nauc_mrr_at_1000_max
      value: 32.71613265858574
    - type: nauc_mrr_at_1000_std
      value: -6.309541407889255
    - type: nauc_mrr_at_100_diff1
      value: 43.08243504279048
    - type: nauc_mrr_at_100_max
      value: 32.72393721047513
    - type: nauc_mrr_at_100_std
      value: -6.304478684547192
    - type: nauc_mrr_at_10_diff1
      value: 42.9454520799358
    - type: nauc_mrr_at_10_max
      value: 32.98294125539359
    - type: nauc_mrr_at_10_std
      value: -6.344731638595535
    - type: nauc_mrr_at_1_diff1
      value: 44.86265224618521
    - type: nauc_mrr_at_1_max
      value: 28.722584310944548
    - type: nauc_mrr_at_1_std
      value: -5.987388514445873
    - type: nauc_mrr_at_20_diff1
      value: 43.09463525559641
    - type: nauc_mrr_at_20_max
      value: 32.78563812600394
    - type: nauc_mrr_at_20_std
      value: -6.3101564030679365
    - type: nauc_mrr_at_3_diff1
      value: 42.778839940801525
    - type: nauc_mrr_at_3_max
      value: 32.73472475200481
    - type: nauc_mrr_at_3_std
      value: -6.873684661851209
    - type: nauc_mrr_at_5_diff1
      value: 42.819150151235355
    - type: nauc_mrr_at_5_max
      value: 33.063649047927846
    - type: nauc_mrr_at_5_std
      value: -6.690698773431876
    - type: nauc_ndcg_at_1000_diff1
      value: 42.838890830794305
    - type: nauc_ndcg_at_1000_max
      value: 33.06212912224441
    - type: nauc_ndcg_at_1000_std
      value: -7.604830337911507
    - type: nauc_ndcg_at_100_diff1
      value: 42.92532259135676
    - type: nauc_ndcg_at_100_max
      value: 33.32105898079442
    - type: nauc_ndcg_at_100_std
      value: -7.41942657927501
    - type: nauc_ndcg_at_10_diff1
      value: 42.241497889945386
    - type: nauc_ndcg_at_10_max
      value: 34.314029244865395
    - type: nauc_ndcg_at_10_std
      value: -8.705170475797276
    - type: nauc_ndcg_at_1_diff1
      value: 44.935431451080625
    - type: nauc_ndcg_at_1_max
      value: 28.761716507796287
    - type: nauc_ndcg_at_1_std
      value: -5.910155765778751
    - type: nauc_ndcg_at_20_diff1
      value: 42.98682996645045
    - type: nauc_ndcg_at_20_max
      value: 33.77639762275077
    - type: nauc_ndcg_at_20_std
      value: -7.922192840991434
    - type: nauc_ndcg_at_3_diff1
      value: 41.78169420045572
    - type: nauc_ndcg_at_3_max
      value: 32.28874867052525
    - type: nauc_ndcg_at_3_std
      value: -10.746022839903787
    - type: nauc_ndcg_at_5_diff1
      value: 41.98111900699031
    - type: nauc_ndcg_at_5_max
      value: 34.16892401395189
    - type: nauc_ndcg_at_5_std
      value: -9.835814208233074
    - type: nauc_precision_at_1000_diff1
      value: -13.893084426310164
    - type: nauc_precision_at_1000_max
      value: 4.528511169827012
    - type: nauc_precision_at_1000_std
      value: 19.808766541210563
    - type: nauc_precision_at_100_diff1
      value: -11.662187818787977
    - type: nauc_precision_at_100_max
      value: 7.106144289556965
    - type: nauc_precision_at_100_std
      value: 20.196725761912955
    - type: nauc_precision_at_10_diff1
      value: -0.0005202624402562934
    - type: nauc_precision_at_10_max
      value: 20.3322025815174
    - type: nauc_precision_at_10_std
      value: 10.996026572368203
    - type: nauc_precision_at_1_diff1
      value: 44.935431451080625
    - type: nauc_precision_at_1_max
      value: 28.761716507796287
    - type: nauc_precision_at_1_std
      value: -5.910155765778751
    - type: nauc_precision_at_20_diff1
      value: -5.251925401801626
    - type: nauc_precision_at_20_max
      value: 13.778502821797181
    - type: nauc_precision_at_20_std
      value: 16.678382538020593
    - type: nauc_precision_at_3_diff1
      value: 18.484347552428737
    - type: nauc_precision_at_3_max
      value: 29.23890691678369
    - type: nauc_precision_at_3_std
      value: -0.9617922081812927
    - type: nauc_precision_at_5_diff1
      value: 9.520921672164247
    - type: nauc_precision_at_5_max
      value: 26.114118384437084
    - type: nauc_precision_at_5_std
      value: 4.480542966435442
    - type: nauc_recall_at_1000_diff1
      value: 36.483312921782804
    - type: nauc_recall_at_1000_max
      value: 93.65683358360806
    - type: nauc_recall_at_1000_std
      value: 78.98396666115225
    - type: nauc_recall_at_100_diff1
      value: 51.223962258353374
    - type: nauc_recall_at_100_max
      value: 71.21642758603197
    - type: nauc_recall_at_100_std
      value: 29.03844845781408
    - type: nauc_recall_at_10_diff1
      value: 36.54228767944346
    - type: nauc_recall_at_10_max
      value: 48.045414485215495
    - type: nauc_recall_at_10_std
      value: -10.991004552070361
    - type: nauc_recall_at_1_diff1
      value: 44.97465030457452
    - type: nauc_recall_at_1_max
      value: 24.50842235041081
    - type: nauc_recall_at_1_std
      value: -9.488301413929715
    - type: nauc_recall_at_20_diff1
      value: 44.42937548103678
    - type: nauc_recall_at_20_max
      value: 52.02797641154168
    - type: nauc_recall_at_20_std
      value: -5.274872422912074
    - type: nauc_recall_at_3_diff1
      value: 37.370700905004796
    - type: nauc_recall_at_3_max
      value: 35.051545542223735
    - type: nauc_recall_at_3_std
      value: -14.47614675395727
    - type: nauc_recall_at_5_diff1
      value: 36.923681333914296
    - type: nauc_recall_at_5_max
      value: 41.76113305221287
    - type: nauc_recall_at_5_std
      value: -13.792057613912453
    - type: ndcg_at_1
      value: 54.547999999999995
    - type: ndcg_at_10
      value: 72.439
    - type: ndcg_at_100
      value: 74.505
    - type: ndcg_at_1000
      value: 74.656
    - type: ndcg_at_20
      value: 73.708
    - type: ndcg_at_3
      value: 66.416
    - type: ndcg_at_5
      value: 69.783
    - type: precision_at_1
      value: 54.547999999999995
    - type: precision_at_10
      value: 10.831
    - type: precision_at_100
      value: 1.201
    - type: precision_at_1000
      value: 0.121
    - type: precision_at_20
      value: 5.734
    - type: precision_at_3
      value: 29.287000000000003
    - type: precision_at_5
      value: 19.676
    - type: recall_at_1
      value: 48.588
    - type: recall_at_10
      value: 90.271
    - type: recall_at_100
      value: 98.663
    - type: recall_at_1000
      value: 99.754
    - type: recall_at_20
      value: 94.911
    - type: recall_at_3
      value: 75.14699999999999
    - type: recall_at_5
      value: 82.657
  - task:
      type: Retrieval
    dataset:
      name: MTEB QuoraRetrieval
      type: mteb/quora
      config: default
      split: test
      revision: e4e08e0b7dbe3c8700f0daef558ff32256715259
    metrics:
    - type: main_score
      value: 88.776
    - type: map_at_1
      value: 70.789
    - type: map_at_10
      value: 85.111
    - type: map_at_100
      value: 85.74300000000001
    - type: map_at_1000
      value: 85.757
    - type: map_at_20
      value: 85.541
    - type: map_at_3
      value: 82.16799999999999
    - type: map_at_5
      value: 84.027
    - type: mrr_at_1
      value: 81.61
    - type: mrr_at_10
      value: 87.83598809523794
    - type: mrr_at_100
      value: 87.93437534934736
    - type: mrr_at_1000
      value: 87.93537663994458
    - type: mrr_at_20
      value: 87.91460020324512
    - type: mrr_at_3
      value: 86.91999999999982
    - type: mrr_at_5
      value: 87.57549999999974
    - type: nauc_map_at_1000_diff1
      value: 76.95785603654109
    - type: nauc_map_at_1000_max
      value: 22.21137147646329
    - type: nauc_map_at_1000_std
      value: -57.67191596659913
    - type: nauc_map_at_100_diff1
      value: 76.96066980419408
    - type: nauc_map_at_100_max
      value: 22.18444499684965
    - type: nauc_map_at_100_std
      value: -57.73426948321203
    - type: nauc_map_at_10_diff1
      value: 77.27294101132748
    - type: nauc_map_at_10_max
      value: 21.520023788398827
    - type: nauc_map_at_10_std
      value: -60.149831861475946
    - type: nauc_map_at_1_diff1
      value: 80.82075671924613
    - type: nauc_map_at_1_max
      value: 16.73924350448738
    - type: nauc_map_at_1_std
      value: -49.025641726356106
    - type: nauc_map_at_20_diff1
      value: 77.03897352655657
    - type: nauc_map_at_20_max
      value: 21.879911910556256
    - type: nauc_map_at_20_std
      value: -58.72111603413064
    - type: nauc_map_at_3_diff1
      value: 77.80825908555062
    - type: nauc_map_at_3_max
      value: 19.74347230686499
    - type: nauc_map_at_3_std
      value: -61.14048758808322
    - type: nauc_map_at_5_diff1
      value: 77.64191093638766
    - type: nauc_map_at_5_max
      value: 20.82641310481968
    - type: nauc_map_at_5_std
      value: -61.5227187788429
    - type: nauc_mrr_at_1000_diff1
      value: 77.07743481780578
    - type: nauc_mrr_at_1000_max
      value: 24.973854693758668
    - type: nauc_mrr_at_1000_std
      value: -53.00097552882813
    - type: nauc_mrr_at_100_diff1
      value: 77.07743779388264
    - type: nauc_mrr_at_100_max
      value: 24.97578180973678
    - type: nauc_mrr_at_100_std
      value: -52.999857842949375
    - type: nauc_mrr_at_10_diff1
      value: 77.08832159626124
    - type: nauc_mrr_at_10_max
      value: 24.847950790779755
    - type: nauc_mrr_at_10_std
      value: -53.354412157484596
    - type: nauc_mrr_at_1_diff1
      value: 77.90054473035877
    - type: nauc_mrr_at_1_max
      value: 25.435382042849454
    - type: nauc_mrr_at_1_std
      value: -48.65542470772514
    - type: nauc_mrr_at_20_diff1
      value: 77.07410903358165
    - type: nauc_mrr_at_20_max
      value: 24.936803370937003
    - type: nauc_mrr_at_20_std
      value: -53.05367000547051
    - type: nauc_mrr_at_3_diff1
      value: 76.79835377348654
    - type: nauc_mrr_at_3_max
      value: 24.83960583182869
    - type: nauc_mrr_at_3_std
      value: -53.937122802902906
    - type: nauc_mrr_at_5_diff1
      value: 77.0611598562459
    - type: nauc_mrr_at_5_max
      value: 25.110143361000386
    - type: nauc_mrr_at_5_std
      value: -53.66721083549211
    - type: nauc_ndcg_at_1000_diff1
      value: 76.6539942038112
    - type: nauc_ndcg_at_1000_max
      value: 23.44145468342362
    - type: nauc_ndcg_at_1000_std
      value: -55.778951082488604
    - type: nauc_ndcg_at_100_diff1
      value: 76.63968651875747
    - type: nauc_ndcg_at_100_max
      value: 23.37238335196869
    - type: nauc_ndcg_at_100_std
      value: -56.013444819578936
    - type: nauc_ndcg_at_10_diff1
      value: 76.91486559815172
    - type: nauc_ndcg_at_10_max
      value: 21.882218185355374
    - type: nauc_ndcg_at_10_std
      value: -60.447241565220914
    - type: nauc_ndcg_at_1_diff1
      value: 77.91920303932993
    - type: nauc_ndcg_at_1_max
      value: 25.506195225143564
    - type: nauc_ndcg_at_1_std
      value: -48.66289988343474
    - type: nauc_ndcg_at_20_diff1
      value: 76.70353035362932
    - type: nauc_ndcg_at_20_max
      value: 22.52326792272016
    - type: nauc_ndcg_at_20_std
      value: -58.228058595950415
    - type: nauc_ndcg_at_3_diff1
      value: 76.19291654415437
    - type: nauc_ndcg_at_3_max
      value: 21.680157583116596
    - type: nauc_ndcg_at_3_std
      value: -59.78592789656886
    - type: nauc_ndcg_at_5_diff1
      value: 76.94117372509868
    - type: nauc_ndcg_at_5_max
      value: 21.80365013527183
    - type: nauc_ndcg_at_5_std
      value: -61.23723747585645
    - type: nauc_precision_at_1000_diff1
      value: -44.43454847128405
    - type: nauc_precision_at_1000_max
      value: 1.1086245603647116
    - type: nauc_precision_at_1000_std
      value: 45.957621410588445
    - type: nauc_precision_at_100_diff1
      value: -44.21353890734024
    - type: nauc_precision_at_100_max
      value: 0.8667205449931505
    - type: nauc_precision_at_100_std
      value: 44.55558297469162
    - type: nauc_precision_at_10_diff1
      value: -39.446583654372816
    - type: nauc_precision_at_10_max
      value: 1.0745424122581824
    - type: nauc_precision_at_10_std
      value: 27.715199044430115
    - type: nauc_precision_at_1_diff1
      value: 77.91920303932993
    - type: nauc_precision_at_1_max
      value: 25.506195225143564
    - type: nauc_precision_at_1_std
      value: -48.66289988343474
    - type: nauc_precision_at_20_diff1
      value: -42.82034326897596
    - type: nauc_precision_at_20_max
      value: 0.1871272488795601
    - type: nauc_precision_at_20_std
      value: 36.44930040826729
    - type: nauc_precision_at_3_diff1
      value: -20.17153834304044
    - type: nauc_precision_at_3_max
      value: 6.091482816522112
    - type: nauc_precision_at_3_std
      value: 2.2214080229171813
    - type: nauc_precision_at_5_diff1
      value: -32.30370373592924
    - type: nauc_precision_at_5_max
      value: 3.283007853748956
    - type: nauc_precision_at_5_std
      value: 15.671527569593394
    - type: nauc_recall_at_1000_diff1
      value: 25.2608289691968
    - type: nauc_recall_at_1000_max
      value: 39.63179474797547
    - type: nauc_recall_at_1000_std
      value: 25.74798035229638
    - type: nauc_recall_at_100_diff1
      value: 68.6766275832437
    - type: nauc_recall_at_100_max
      value: 24.369103177128636
    - type: nauc_recall_at_100_std
      value: -62.93899349940275
    - type: nauc_recall_at_10_diff1
      value: 73.75469598044158
    - type: nauc_recall_at_10_max
      value: 10.798765439257565
    - type: nauc_recall_at_10_std
      value: -90.65150692145126
    - type: nauc_recall_at_1_diff1
      value: 80.82075671924613
    - type: nauc_recall_at_1_max
      value: 16.73924350448738
    - type: nauc_recall_at_1_std
      value: -49.025641726356106
    - type: nauc_recall_at_20_diff1
      value: 71.88106544370252
    - type: nauc_recall_at_20_max
      value: 8.617919317783445
    - type: nauc_recall_at_20_std
      value: -88.64614006261976
    - type: nauc_recall_at_3_diff1
      value: 73.67512305142627
    - type: nauc_recall_at_3_max
      value: 14.522053228776684
    - type: nauc_recall_at_3_std
      value: -72.6164829975551
    - type: nauc_recall_at_5_diff1
      value: 73.55224072247896
    - type: nauc_recall_at_5_max
      value: 14.028581019140384
    - type: nauc_recall_at_5_std
      value: -81.70290837756839
    - type: ndcg_at_1
      value: 81.6
    - type: ndcg_at_10
      value: 88.776
    - type: ndcg_at_100
      value: 89.91799999999999
    - type: ndcg_at_1000
      value: 90.001
    - type: ndcg_at_20
      value: 89.45100000000001
    - type: ndcg_at_3
      value: 86.055
    - type: ndcg_at_5
      value: 87.603
    - type: precision_at_1
      value: 81.6
    - type: precision_at_10
      value: 13.527000000000001
    - type: precision_at_100
      value: 1.538
    - type: precision_at_1000
      value: 0.157
    - type: precision_at_20
      value: 7.183000000000001
    - type: precision_at_3
      value: 37.81
    - type: precision_at_5
      value: 24.874
    - type: recall_at_1
      value: 70.789
    - type: recall_at_10
      value: 95.829
    - type: recall_at_100
      value: 99.626
    - type: recall_at_1000
      value: 99.99900000000001
    - type: recall_at_20
      value: 98.008
    - type: recall_at_3
      value: 88.005
    - type: recall_at_5
      value: 92.394
  - task:
      type: Retrieval
    dataset:
      name: MTEB SCIDOCS
      type: mteb/scidocs
      config: default
      split: test
      revision: f8c2fcf00f625baaa80f62ec5bd9e1fff3b8ae88
    metrics:
    - type: main_score
      value: 22.555
    - type: map_at_1
      value: 5.093
    - type: map_at_10
      value: 13.636000000000001
    - type: map_at_100
      value: 16.169
    - type: map_at_1000
      value: 16.491
    - type: map_at_20
      value: 14.967
    - type: map_at_3
      value: 9.759
    - type: map_at_5
      value: 11.61
    - type: mrr_at_1
      value: 25.1
    - type: mrr_at_10
      value: 37.03158730158728
    - type: mrr_at_100
      value: 38.10841522691227
    - type: mrr_at_1000
      value: 38.157760714646216
    - type: mrr_at_20
      value: 37.71533302009304
    - type: mrr_at_3
      value: 33.599999999999994
    - type: mrr_at_5
      value: 35.47499999999996
    - type: nauc_map_at_1000_diff1
      value: 16.016506811794674
    - type: nauc_map_at_1000_max
      value: 26.980626723493234
    - type: nauc_map_at_1000_std
      value: 6.344668577266132
    - type: nauc_map_at_100_diff1
      value: 16.106273177734288
    - type: nauc_map_at_100_max
      value: 27.078961630580306
    - type: nauc_map_at_100_std
      value: 6.114177505174807
    - type: nauc_map_at_10_diff1
      value: 17.401956757885728
    - type: nauc_map_at_10_max
      value: 26.276474643260777
    - type: nauc_map_at_10_std
      value: 3.005814701827781
    - type: nauc_map_at_1_diff1
      value: 20.70536617482489
    - type: nauc_map_at_1_max
      value: 16.988060184234318
    - type: nauc_map_at_1_std
      value: -3.4275203611745013
    - type: nauc_map_at_20_diff1
      value: 16.56893037536464
    - type: nauc_map_at_20_max
      value: 26.994627506463566
    - type: nauc_map_at_20_std
      value: 4.443682314555823
    - type: nauc_map_at_3_diff1
      value: 17.771054815531336
    - type: nauc_map_at_3_max
      value: 22.25552550616846
    - type: nauc_map_at_3_std
      value: -1.1135548486711386
    - type: nauc_map_at_5_diff1
      value: 18.234751966525035
    - type: nauc_map_at_5_max
      value: 24.74090977327922
    - type: nauc_map_at_5_std
      value: 0.20984608573778366
    - type: nauc_mrr_at_1000_diff1
      value: 16.43908145424862
    - type: nauc_mrr_at_1000_max
      value: 19.50975861939652
    - type: nauc_mrr_at_1000_std
      value: 1.0711066308930413
    - type: nauc_mrr_at_100_diff1
      value: 16.449978087023602
    - type: nauc_mrr_at_100_max
      value: 19.546163139729455
    - type: nauc_mrr_at_100_std
      value: 1.1255804840602446
    - type: nauc_mrr_at_10_diff1
      value: 16.349572894206453
    - type: nauc_mrr_at_10_max
      value: 19.36607987819692
    - type: nauc_mrr_at_10_std
      value: 0.6815489423750116
    - type: nauc_mrr_at_1_diff1
      value: 20.81511754780404
    - type: nauc_mrr_at_1_max
      value: 17.31621820467371
    - type: nauc_mrr_at_1_std
      value: -3.062161046879616
    - type: nauc_mrr_at_20_diff1
      value: 16.453078176658412
    - type: nauc_mrr_at_20_max
      value: 19.61511763534643
    - type: nauc_mrr_at_20_std
      value: 1.1504468243169772
    - type: nauc_mrr_at_3_diff1
      value: 16.45317063630442
    - type: nauc_mrr_at_3_max
      value: 18.820538793222735
    - type: nauc_mrr_at_3_std
      value: -0.505799010681032
    - type: nauc_mrr_at_5_diff1
      value: 16.239396076435447
    - type: nauc_mrr_at_5_max
      value: 19.514405308342404
    - type: nauc_mrr_at_5_std
      value: 0.42152258676157106
    - type: nauc_ndcg_at_1000_diff1
      value: 12.799637809854447
    - type: nauc_ndcg_at_1000_max
      value: 26.286436521297098
    - type: nauc_ndcg_at_1000_std
      value: 13.849793575042407
    - type: nauc_ndcg_at_100_diff1
      value: 13.780919818793214
    - type: nauc_ndcg_at_100_max
      value: 27.263414842629384
    - type: nauc_ndcg_at_100_std
      value: 12.844324409823212
    - type: nauc_ndcg_at_10_diff1
      value: 15.691735156401645
    - type: nauc_ndcg_at_10_max
      value: 25.546421591723778
    - type: nauc_ndcg_at_10_std
      value: 5.030693260079141
    - type: nauc_ndcg_at_1_diff1
      value: 20.81511754780404
    - type: nauc_ndcg_at_1_max
      value: 17.31621820467371
    - type: nauc_ndcg_at_1_std
      value: -3.062161046879616
    - type: nauc_ndcg_at_20_diff1
      value: 14.918017633315037
    - type: nauc_ndcg_at_20_max
      value: 27.198495675799926
    - type: nauc_ndcg_at_20_std
      value: 7.859145154218754
    - type: nauc_ndcg_at_3_diff1
      value: 16.45411219760524
    - type: nauc_ndcg_at_3_max
      value: 21.843580863721826
    - type: nauc_ndcg_at_3_std
      value: 0.25079066807691736
    - type: nauc_ndcg_at_5_diff1
      value: 16.51852886026338
    - type: nauc_ndcg_at_5_max
      value: 24.32358445742888
    - type: nauc_ndcg_at_5_std
      value: 2.0046033593381365
    - type: nauc_precision_at_1000_diff1
      value: -3.043549167595678
    - type: nauc_precision_at_1000_max
      value: 17.721081069519855
    - type: nauc_precision_at_1000_std
      value: 34.394832596775096
    - type: nauc_precision_at_100_diff1
      value: 5.918389112534078
    - type: nauc_precision_at_100_max
      value: 25.041523333915638
    - type: nauc_precision_at_100_std
      value: 26.422448938245065
    - type: nauc_precision_at_10_diff1
      value: 12.559354156188075
    - type: nauc_precision_at_10_max
      value: 27.102948515447505
    - type: nauc_precision_at_10_std
      value: 9.922230490706765
    - type: nauc_precision_at_1_diff1
      value: 20.81511754780404
    - type: nauc_precision_at_1_max
      value: 17.31621820467371
    - type: nauc_precision_at_1_std
      value: -3.062161046879616
    - type: nauc_precision_at_20_diff1
      value: 10.239015656701062
    - type: nauc_precision_at_20_max
      value: 28.631431971198385
    - type: nauc_precision_at_20_std
      value: 14.923889979389953
    - type: nauc_precision_at_3_diff1
      value: 14.715917541943435
    - type: nauc_precision_at_3_max
      value: 23.488016057716443
    - type: nauc_precision_at_3_std
      value: 1.8688429519876193
    - type: nauc_precision_at_5_diff1
      value: 14.607533180532764
    - type: nauc_precision_at_5_max
      value: 26.69556237014592
    - type: nauc_precision_at_5_std
      value: 4.869786655689707
    - type: nauc_recall_at_1000_diff1
      value: -3.592050112505089
    - type: nauc_recall_at_1000_max
      value: 17.35902743346563
    - type: nauc_recall_at_1000_std
      value: 35.46357913035807
    - type: nauc_recall_at_100_diff1
      value: 5.712224816491693
    - type: nauc_recall_at_100_max
      value: 24.952810805795224
    - type: nauc_recall_at_100_std
      value: 26.49557743326384
    - type: nauc_recall_at_10_diff1
      value: 12.374218338608538
    - type: nauc_recall_at_10_max
      value: 26.5955214750823
    - type: nauc_recall_at_10_std
      value: 9.623097045252097
    - type: nauc_recall_at_1_diff1
      value: 20.70536617482489
    - type: nauc_recall_at_1_max
      value: 16.988060184234318
    - type: nauc_recall_at_1_std
      value: -3.4275203611745013
    - type: nauc_recall_at_20_diff1
      value: 10.079156462598272
    - type: nauc_recall_at_20_max
      value: 28.130382940517656
    - type: nauc_recall_at_20_std
      value: 14.778620879657767
    - type: nauc_recall_at_3_diff1
      value: 14.445322713318905
    - type: nauc_recall_at_3_max
      value: 22.913177040177732
    - type: nauc_recall_at_3_std
      value: 1.3968297812096289
    - type: nauc_recall_at_5_diff1
      value: 14.300977741042697
    - type: nauc_recall_at_5_max
      value: 26.064746286034463
    - type: nauc_recall_at_5_std
      value: 4.468436508425328
    - type: ndcg_at_1
      value: 25.1
    - type: ndcg_at_10
      value: 22.555
    - type: ndcg_at_100
      value: 31.558000000000003
    - type: ndcg_at_1000
      value: 36.866
    - type: ndcg_at_20
      value: 25.954
    - type: ndcg_at_3
      value: 21.488
    - type: ndcg_at_5
      value: 18.656
    - type: precision_at_1
      value: 25.1
    - type: precision_at_10
      value: 11.82
    - type: precision_at_100
      value: 2.465
    - type: precision_at_1000
      value: 0.373
    - type: precision_at_20
      value: 7.870000000000001
    - type: precision_at_3
      value: 20.467
    - type: precision_at_5
      value: 16.520000000000003
    - type: recall_at_1
      value: 5.093
    - type: recall_at_10
      value: 23.953
    - type: recall_at_100
      value: 50.03999999999999
    - type: recall_at_1000
      value: 75.74499999999999
    - type: recall_at_20
      value: 31.923000000000002
    - type: recall_at_3
      value: 12.468
    - type: recall_at_5
      value: 16.773
  - task:
      type: Retrieval
    dataset:
      name: MTEB SciFact
      type: mteb/scifact
      config: default
      split: test
      revision: 0228b52cf27578f30900b9e5271d331663a030d7
    metrics:
    - type: main_score
      value: 81.313
    - type: map_at_1
      value: 67.38300000000001
    - type: map_at_10
      value: 77.017
    - type: map_at_100
      value: 77.321
    - type: map_at_1000
      value: 77.331
    - type: map_at_20
      value: 77.262
    - type: map_at_3
      value: 74.111
    - type: map_at_5
      value: 75.881
    - type: mrr_at_1
      value: 70.33333333333334
    - type: mrr_at_10
      value: 77.81560846560845
    - type: mrr_at_100
      value: 78.00735197296981
    - type: mrr_at_1000
      value: 78.01761089473817
    - type: mrr_at_20
      value: 77.95766363266362
    - type: mrr_at_3
      value: 75.72222222222223
    - type: mrr_at_5
      value: 77.00555555555557
    - type: nauc_map_at_1000_diff1
      value: 75.04841791054689
    - type: nauc_map_at_1000_max
      value: 58.36172663414763
    - type: nauc_map_at_1000_std
      value: -11.893595632272119
    - type: nauc_map_at_100_diff1
      value: 75.05064539007354
    - type: nauc_map_at_100_max
      value: 58.37324776917011
    - type: nauc_map_at_100_std
      value: -11.877215894403568
    - type: nauc_map_at_10_diff1
      value: 74.75549994121076
    - type: nauc_map_at_10_max
      value: 58.24150489656241
    - type: nauc_map_at_10_std
      value: -12.344245577155307
    - type: nauc_map_at_1_diff1
      value: 76.73802929240316
    - type: nauc_map_at_1_max
      value: 51.51486878608817
    - type: nauc_map_at_1_std
      value: -18.187044359595266
    - type: nauc_map_at_20_diff1
      value: 75.01108764373232
    - type: nauc_map_at_20_max
      value: 58.428062710077334
    - type: nauc_map_at_20_std
      value: -11.884812488296847
    - type: nauc_map_at_3_diff1
      value: 75.76878808666785
    - type: nauc_map_at_3_max
      value: 55.0893236506397
    - type: nauc_map_at_3_std
      value: -18.680147004087416
    - type: nauc_map_at_5_diff1
      value: 75.21872474724155
    - type: nauc_map_at_5_max
      value: 56.99417811848851
    - type: nauc_map_at_5_std
      value: -15.023574589807998
    - type: nauc_mrr_at_1000_diff1
      value: 75.30185058060118
    - type: nauc_mrr_at_1000_max
      value: 58.99827784504953
    - type: nauc_mrr_at_1000_std
      value: -9.180976480652097
    - type: nauc_mrr_at_100_diff1
      value: 75.3039902169212
    - type: nauc_mrr_at_100_max
      value: 59.0096982171748
    - type: nauc_mrr_at_100_std
      value: -9.165687912589478
    - type: nauc_mrr_at_10_diff1
      value: 75.06584397042454
    - type: nauc_mrr_at_10_max
      value: 59.059479758705095
    - type: nauc_mrr_at_10_std
      value: -9.171739325385065
    - type: nauc_mrr_at_1_diff1
      value: 76.94126061472998
    - type: nauc_mrr_at_1_max
      value: 58.63634435063004
    - type: nauc_mrr_at_1_std
      value: -7.595328003491241
    - type: nauc_mrr_at_20_diff1
      value: 75.25985436830398
    - type: nauc_mrr_at_20_max
      value: 59.047844055490515
    - type: nauc_mrr_at_20_std
      value: -9.217229457280327
    - type: nauc_mrr_at_3_diff1
      value: 75.70972174140121
    - type: nauc_mrr_at_3_max
      value: 58.53109550921837
    - type: nauc_mrr_at_3_std
      value: -11.233362761574888
    - type: nauc_mrr_at_5_diff1
      value: 75.3027582677559
    - type: nauc_mrr_at_5_max
      value: 58.51186203154683
    - type: nauc_mrr_at_5_std
      value: -10.2389936280827
    - type: nauc_ndcg_at_1000_diff1
      value: 74.73042662069368
    - type: nauc_ndcg_at_1000_max
      value: 59.234679098286435
    - type: nauc_ndcg_at_1000_std
      value: -10.056585749544686
    - type: nauc_ndcg_at_100_diff1
      value: 74.77417755774573
    - type: nauc_ndcg_at_100_max
      value: 59.56267106047054
    - type: nauc_ndcg_at_100_std
      value: -9.507635585959678
    - type: nauc_ndcg_at_10_diff1
      value: 73.51173182085725
    - type: nauc_ndcg_at_10_max
      value: 59.488170283330234
    - type: nauc_ndcg_at_10_std
      value: -10.720733926384735
    - type: nauc_ndcg_at_1_diff1
      value: 76.94126061472998
    - type: nauc_ndcg_at_1_max
      value: 58.63634435063004
    - type: nauc_ndcg_at_1_std
      value: -7.595328003491241
    - type: nauc_ndcg_at_20_diff1
      value: 74.40614935696766
    - type: nauc_ndcg_at_20_max
      value: 59.958864387137226
    - type: nauc_ndcg_at_20_std
      value: -9.611226342001965
    - type: nauc_ndcg_at_3_diff1
      value: 75.17084819068555
    - type: nauc_ndcg_at_3_max
      value: 57.01635203576452
    - type: nauc_ndcg_at_3_std
      value: -16.69034944254818
    - type: nauc_ndcg_at_5_diff1
      value: 74.42154242123861
    - type: nauc_ndcg_at_5_max
      value: 56.96751544369478
    - type: nauc_ndcg_at_5_std
      value: -15.466581364009777
    - type: nauc_precision_at_1000_diff1
      value: -29.885864068853113
    - type: nauc_precision_at_1000_max
      value: 15.246331345070333
    - type: nauc_precision_at_1000_std
      value: 64.18030587603968
    - type: nauc_precision_at_100_diff1
      value: -22.526159307459164
    - type: nauc_precision_at_100_max
      value: 19.83878305556087
    - type: nauc_precision_at_100_std
      value: 61.81734299609778
    - type: nauc_precision_at_10_diff1
      value: -9.744869185690087
    - type: nauc_precision_at_10_max
      value: 30.835764902042573
    - type: nauc_precision_at_10_std
      value: 51.66797440109854
    - type: nauc_precision_at_1_diff1
      value: 76.94126061472998
    - type: nauc_precision_at_1_max
      value: 58.63634435063004
    - type: nauc_precision_at_1_std
      value: -7.595328003491241
    - type: nauc_precision_at_20_diff1
      value: -15.854662566288075
    - type: nauc_precision_at_20_max
      value: 25.540596169213263
    - type: nauc_precision_at_20_std
      value: 57.87224253577742
    - type: nauc_precision_at_3_diff1
      value: 36.685786823107975
    - type: nauc_precision_at_3_max
      value: 45.39544319415371
    - type: nauc_precision_at_3_std
      value: 8.267737553608583
    - type: nauc_precision_at_5_diff1
      value: 15.315102224001208
    - type: nauc_precision_at_5_max
      value: 39.43523589454333
    - type: nauc_precision_at_5_std
      value: 29.17523334728261
    - type: nauc_recall_at_1000_diff1
    - type: nauc_recall_at_1000_max
    - type: nauc_recall_at_1000_std
    - type: nauc_recall_at_100_diff1
      value: 77.35760971055122
    - type: nauc_recall_at_100_max
      value: 82.1661998132589
    - type: nauc_recall_at_100_std
      value: 29.74789915966396
    - type: nauc_recall_at_10_diff1
      value: 60.19810822879889
    - type: nauc_recall_at_10_max
      value: 65.9952096780744
    - type: nauc_recall_at_10_std
      value: -8.764259326919047
    - type: nauc_recall_at_1_diff1
      value: 76.73802929240316
    - type: nauc_recall_at_1_max
      value: 51.51486878608817
    - type: nauc_recall_at_1_std
      value: -18.187044359595266
    - type: nauc_recall_at_20_diff1
      value: 66.887914586124
    - type: nauc_recall_at_20_max
      value: 77.53014249177924
    - type: nauc_recall_at_20_std
      value: 6.2375674907644045
    - type: nauc_recall_at_3_diff1
      value: 73.15618370243749
    - type: nauc_recall_at_3_max
      value: 51.8421919050744
    - type: nauc_recall_at_3_std
      value: -30.197347334361
    - type: nauc_recall_at_5_diff1
      value: 69.63152781695797
    - type: nauc_recall_at_5_max
      value: 52.313360589975076
    - type: nauc_recall_at_5_std
      value: -27.475502645659226
    - type: ndcg_at_1
      value: 70.333
    - type: ndcg_at_10
      value: 81.313
    - type: ndcg_at_100
      value: 82.419
    - type: ndcg_at_1000
      value: 82.645
    - type: ndcg_at_20
      value: 82.013
    - type: ndcg_at_3
      value: 76.632
    - type: ndcg_at_5
      value: 79.077
    - type: precision_at_1
      value: 70.333
    - type: precision_at_10
      value: 10.567
    - type: precision_at_100
      value: 1.113
    - type: precision_at_1000
      value: 0.11299999999999999
    - type: precision_at_20
      value: 5.45
    - type: precision_at_3
      value: 29.444
    - type: precision_at_5
      value: 19.400000000000002
    - type: recall_at_1
      value: 67.38300000000001
    - type: recall_at_10
      value: 93.611
    - type: recall_at_100
      value: 98.333
    - type: recall_at_1000
      value: 100
    - type: recall_at_20
      value: 96.167
    - type: recall_at_3
      value: 80.917
    - type: recall_at_5
      value: 87.394
  - task:
      type: Retrieval
    dataset:
      name: MTEB TRECCOVID
      type: mteb/trec-covid
      config: default
      split: test
      revision: bb9466bac8153a0349341eb1b22e06409e78ef4e
    metrics:
    - type: main_score
      value: 86.438
    - type: map_at_1
      value: 0.246
    - type: map_at_10
      value: 2.306
    - type: map_at_100
      value: 14.591000000000001
    - type: map_at_1000
      value: 36.059999999999995
    - type: map_at_20
      value: 4.162
    - type: map_at_3
      value: 0.738
    - type: map_at_5
      value: 1.2189999999999999
    - type: mrr_at_1
      value: 92
    - type: mrr_at_10
      value: 96
    - type: mrr_at_100
      value: 96
    - type: mrr_at_1000
      value: 96
    - type: mrr_at_20
      value: 96
    - type: mrr_at_3
      value: 96
    - type: mrr_at_5
      value: 96
    - type: nauc_map_at_1000_diff1
      value: -22.761515794474683
    - type: nauc_map_at_1000_max
      value: 27.820651228713956
    - type: nauc_map_at_1000_std
      value: 71.83059059452174
    - type: nauc_map_at_100_diff1
      value: 2.1790372665645985
    - type: nauc_map_at_100_max
      value: 14.257921425662278
    - type: nauc_map_at_100_std
      value: 52.48972009046084
    - type: nauc_map_at_10_diff1
      value: 19.82787446032468
    - type: nauc_map_at_10_max
      value: 0.6164112414011461
    - type: nauc_map_at_10_std
      value: 17.02439234880446
    - type: nauc_map_at_1_diff1
      value: 14.55103360563013
    - type: nauc_map_at_1_max
      value: -1.6788350095288704
    - type: nauc_map_at_1_std
      value: 5.297647152979803
    - type: nauc_map_at_20_diff1
      value: 14.8794609533735
    - type: nauc_map_at_20_max
      value: -2.5385796849879476
    - type: nauc_map_at_20_std
      value: 25.28013324056331
    - type: nauc_map_at_3_diff1
      value: 17.00420260483426
    - type: nauc_map_at_3_max
      value: -3.3326758887083994
    - type: nauc_map_at_3_std
      value: 6.755584420286978
    - type: nauc_map_at_5_diff1
      value: 18.01887831857493
    - type: nauc_map_at_5_max
      value: -0.20050837416180262
    - type: nauc_map_at_5_std
      value: 8.561948963118322
    - type: nauc_mrr_at_1000_diff1
      value: -10.971055088702034
    - type: nauc_mrr_at_1000_max
      value: 23.34267040149383
    - type: nauc_mrr_at_1000_std
      value: 46.49859943977593
    - type: nauc_mrr_at_100_diff1
      value: -10.971055088702034
    - type: nauc_mrr_at_100_max
      value: 23.34267040149383
    - type: nauc_mrr_at_100_std
      value: 46.49859943977593
    - type: nauc_mrr_at_10_diff1
      value: -10.971055088702034
    - type: nauc_mrr_at_10_max
      value: 23.34267040149383
    - type: nauc_mrr_at_10_std
      value: 46.49859943977593
    - type: nauc_mrr_at_1_diff1
      value: -10.971055088702213
    - type: nauc_mrr_at_1_max
      value: 23.342670401493866
    - type: nauc_mrr_at_1_std
      value: 46.49859943977584
    - type: nauc_mrr_at_20_diff1
      value: -10.971055088702034
    - type: nauc_mrr_at_20_max
      value: 23.34267040149383
    - type: nauc_mrr_at_20_std
      value: 46.49859943977593
    - type: nauc_mrr_at_3_diff1
      value: -10.971055088702034
    - type: nauc_mrr_at_3_max
      value: 23.34267040149383
    - type: nauc_mrr_at_3_std
      value: 46.49859943977593
    - type: nauc_mrr_at_5_diff1
      value: -10.971055088702034
    - type: nauc_mrr_at_5_max
      value: 23.34267040149383
    - type: nauc_mrr_at_5_std
      value: 46.49859943977593
    - type: nauc_ndcg_at_1000_diff1
      value: -18.31263218691838
    - type: nauc_ndcg_at_1000_max
      value: 27.73438353091248
    - type: nauc_ndcg_at_1000_std
      value: 71.48659179814995
    - type: nauc_ndcg_at_100_diff1
      value: -27.992325451927186
    - type: nauc_ndcg_at_100_max
      value: 28.255864098560707
    - type: nauc_ndcg_at_100_std
      value: 75.14579385079674
    - type: nauc_ndcg_at_10_diff1
      value: -8.144751519247938
    - type: nauc_ndcg_at_10_max
      value: 25.558877520680124
    - type: nauc_ndcg_at_10_std
      value: 74.7572150705637
    - type: nauc_ndcg_at_1_diff1
      value: 16.76577585000697
    - type: nauc_ndcg_at_1_max
      value: 8.307681544704138
    - type: nauc_ndcg_at_1_std
      value: 58.066321533510546
    - type: nauc_ndcg_at_20_diff1
      value: -20.395935610617506
    - type: nauc_ndcg_at_20_max
      value: 13.855324797866162
    - type: nauc_ndcg_at_20_std
      value: 73.28813885551733
    - type: nauc_ndcg_at_3_diff1
      value: 6.617214064862965
    - type: nauc_ndcg_at_3_max
      value: 6.769967032124153
    - type: nauc_ndcg_at_3_std
      value: 58.81924750609674
    - type: nauc_ndcg_at_5_diff1
      value: 4.010229362207553
    - type: nauc_ndcg_at_5_max
      value: 15.806937140075162
    - type: nauc_ndcg_at_5_std
      value: 64.16373136138701
    - type: nauc_precision_at_1000_diff1
      value: -35.69245033890321
    - type: nauc_precision_at_1000_max
      value: 29.773854942146016
    - type: nauc_precision_at_1000_std
      value: 34.51184375699267
    - type: nauc_precision_at_100_diff1
      value: -35.11125639593742
    - type: nauc_precision_at_100_max
      value: 30.702640227422588
    - type: nauc_precision_at_100_std
      value: 71.4996572186129
    - type: nauc_precision_at_10_diff1
      value: -23.298868807095037
    - type: nauc_precision_at_10_max
      value: 39.589436024499705
    - type: nauc_precision_at_10_std
      value: 76.1337980062292
    - type: nauc_precision_at_1_diff1
      value: -10.971055088702213
    - type: nauc_precision_at_1_max
      value: 23.342670401493866
    - type: nauc_precision_at_1_std
      value: 46.49859943977584
    - type: nauc_precision_at_20_diff1
      value: -29.329327980889335
    - type: nauc_precision_at_20_max
      value: 11.858896642149604
    - type: nauc_precision_at_20_std
      value: 67.29665651857641
    - type: nauc_precision_at_3_diff1
      value: -29.222972972972972
    - type: nauc_precision_at_3_max
      value: 29.892615830115947
    - type: nauc_precision_at_3_std
      value: 52.14165057915088
    - type: nauc_precision_at_5_diff1
      value: -28.95650527113159
    - type: nauc_precision_at_5_max
      value: 59.611135660627276
    - type: nauc_precision_at_5_std
      value: 68.33533236538078
    - type: nauc_recall_at_1000_diff1
      value: -12.600696861809551
    - type: nauc_recall_at_1000_max
      value: 23.65718948783771
    - type: nauc_recall_at_1000_std
      value: 58.45976113241065
    - type: nauc_recall_at_100_diff1
      value: 11.646564765343207
    - type: nauc_recall_at_100_max
      value: 8.659686510034886
    - type: nauc_recall_at_100_std
      value: 35.810233566395794
    - type: nauc_recall_at_10_diff1
      value: 21.95634026505432
    - type: nauc_recall_at_10_max
      value: -1.9343852262751597
    - type: nauc_recall_at_10_std
      value: 11.803977166363625
    - type: nauc_recall_at_1_diff1
      value: 14.55103360563013
    - type: nauc_recall_at_1_max
      value: -1.6788350095288704
    - type: nauc_recall_at_1_std
      value: 5.297647152979803
    - type: nauc_recall_at_20_diff1
      value: 18.43436469166756
    - type: nauc_recall_at_20_max
      value: -6.04718458442069
    - type: nauc_recall_at_20_std
      value: 17.696574929265427
    - type: nauc_recall_at_3_diff1
      value: 18.894666026909974
    - type: nauc_recall_at_3_max
      value: -4.980513377878677
    - type: nauc_recall_at_3_std
      value: 2.9597934364239875
    - type: nauc_recall_at_5_diff1
      value: 19.620752388113065
    - type: nauc_recall_at_5_max
      value: -1.622705626776803
    - type: nauc_recall_at_5_std
      value: 4.654905320572235
    - type: ndcg_at_1
      value: 86
    - type: ndcg_at_10
      value: 86.438
    - type: ndcg_at_100
      value: 68.979
    - type: ndcg_at_1000
      value: 61.687000000000005
    - type: ndcg_at_20
      value: 82.494
    - type: ndcg_at_3
      value: 89.011
    - type: ndcg_at_5
      value: 88.629
    - type: precision_at_1
      value: 92
    - type: precision_at_10
      value: 90.60000000000001
    - type: precision_at_100
      value: 70.94
    - type: precision_at_1000
      value: 27.002
    - type: precision_at_20
      value: 86
    - type: precision_at_3
      value: 94.667
    - type: precision_at_5
      value: 93.60000000000001
    - type: recall_at_1
      value: 0.246
    - type: recall_at_10
      value: 2.402
    - type: recall_at_100
      value: 17.463
    - type: recall_at_1000
      value: 58.095
    - type: recall_at_20
      value: 4.449
    - type: recall_at_3
      value: 0.759
    - type: recall_at_5
      value: 1.258
  - task:
      type: Retrieval
    dataset:
      name: MTEB Touche2020
      type: mteb/touche2020
      config: default
      split: test
      revision: a34f9a33db75fa0cbb21bb5cfc3dae8dc8bec93f
    metrics:
    - type: main_score
      value: 26.596999999999998
    - type: map_at_1
      value: 2.492
    - type: map_at_10
      value: 10.735
    - type: map_at_100
      value: 16.682
    - type: map_at_1000
      value: 18.403
    - type: map_at_20
      value: 12.917000000000002
    - type: map_at_3
      value: 5.17
    - type: map_at_5
      value: 7.757
    - type: mrr_at_1
      value: 32.6530612244898
    - type: mrr_at_10
      value: 46.303045027534814
    - type: mrr_at_100
      value: 47.28774571332247
    - type: mrr_at_1000
      value: 47.28774571332247
    - type: mrr_at_20
      value: 47.015586454361966
    - type: mrr_at_3
      value: 40.816326530612244
    - type: mrr_at_5
      value: 44.18367346938775
    - type: nauc_map_at_1000_diff1
      value: 11.335574982192163
    - type: nauc_map_at_1000_max
      value: -0.8598274464471192
    - type: nauc_map_at_1000_std
      value: -15.231845346554659
    - type: nauc_map_at_100_diff1
      value: 11.206116403137699
    - type: nauc_map_at_100_max
      value: -2.3784869726219764
    - type: nauc_map_at_100_std
      value: -18.67373469274601
    - type: nauc_map_at_10_diff1
      value: 14.110151248235939
    - type: nauc_map_at_10_max
      value: -0.28701326962970963
    - type: nauc_map_at_10_std
      value: -33.99696491060436
    - type: nauc_map_at_1_diff1
      value: 21.156709083334775
    - type: nauc_map_at_1_max
      value: -2.157834650647083
    - type: nauc_map_at_1_std
      value: -30.794160263652802
    - type: nauc_map_at_20_diff1
      value: 13.15680258919864
    - type: nauc_map_at_20_max
      value: -3.3318355189188305
    - type: nauc_map_at_20_std
      value: -32.22884578499942
    - type: nauc_map_at_3_diff1
      value: 16.35589367098705
    - type: nauc_map_at_3_max
      value: -2.46509831705108
    - type: nauc_map_at_3_std
      value: -36.778901075123656
    - type: nauc_map_at_5_diff1
      value: 12.399286451976096
    - type: nauc_map_at_5_max
      value: -6.660679305623031
    - type: nauc_map_at_5_std
      value: -37.17482542753885
    - type: nauc_mrr_at_1000_diff1
      value: 35.79771420444037
    - type: nauc_mrr_at_1000_max
      value: 3.96194578776969
    - type: nauc_mrr_at_1000_std
      value: -28.13723455933009
    - type: nauc_mrr_at_100_diff1
      value: 35.79771420444037
    - type: nauc_mrr_at_100_max
      value: 3.96194578776969
    - type: nauc_mrr_at_100_std
      value: -28.13723455933009
    - type: nauc_mrr_at_10_diff1
      value: 35.342862255513786
    - type: nauc_mrr_at_10_max
      value: 3.8834259049036333
    - type: nauc_mrr_at_10_std
      value: -27.68280924117899
    - type: nauc_mrr_at_1_diff1
      value: 33.380355990146
    - type: nauc_mrr_at_1_max
      value: 12.83074393320823
    - type: nauc_mrr_at_1_std
      value: -23.4424761925381
    - type: nauc_mrr_at_20_diff1
      value: 35.962814146075594
    - type: nauc_mrr_at_20_max
      value: 3.8147946011890803
    - type: nauc_mrr_at_20_std
      value: -27.60539100275652
    - type: nauc_mrr_at_3_diff1
      value: 33.12022321313229
    - type: nauc_mrr_at_3_max
      value: 3.4480043310191277
    - type: nauc_mrr_at_3_std
      value: -32.92204805838337
    - type: nauc_mrr_at_5_diff1
      value: 35.97719343207735
    - type: nauc_mrr_at_5_max
      value: 2.757619527166485
    - type: nauc_mrr_at_5_std
      value: -30.80006606256878
    - type: nauc_ndcg_at_1000_diff1
      value: 18.11533813577644
    - type: nauc_ndcg_at_1000_max
      value: 1.9915750044715081
    - type: nauc_ndcg_at_1000_std
      value: 7.352102753749795
    - type: nauc_ndcg_at_100_diff1
      value: 15.924538562545404
    - type: nauc_ndcg_at_100_max
      value: -7.179439986891839
    - type: nauc_ndcg_at_100_std
      value: 2.0323790255423355
    - type: nauc_ndcg_at_10_diff1
      value: 23.447559750152287
    - type: nauc_ndcg_at_10_max
      value: -3.6579030981671137
    - type: nauc_ndcg_at_10_std
      value: -30.086068424084626
    - type: nauc_ndcg_at_1_diff1
      value: 28.529374726155144
    - type: nauc_ndcg_at_1_max
      value: 12.404802289906062
    - type: nauc_ndcg_at_1_std
      value: -24.04566237921898
    - type: nauc_ndcg_at_20_diff1
      value: 18.242702297694578
    - type: nauc_ndcg_at_20_max
      value: -11.247547069942474
    - type: nauc_ndcg_at_20_std
      value: -26.997061324593357
    - type: nauc_ndcg_at_3_diff1
      value: 28.69532079386643
    - type: nauc_ndcg_at_3_max
      value: 0.5999757426015948
    - type: nauc_ndcg_at_3_std
      value: -37.39763786997949
    - type: nauc_ndcg_at_5_diff1
      value: 22.250418536855168
    - type: nauc_ndcg_at_5_max
      value: -5.282078779032189
    - type: nauc_ndcg_at_5_std
      value: -37.34621514266717
    - type: nauc_precision_at_1000_diff1
      value: -5.833939931080579
    - type: nauc_precision_at_1000_max
      value: 39.54611889184263
    - type: nauc_precision_at_1000_std
      value: 43.621604632945406
    - type: nauc_precision_at_100_diff1
      value: 3.136900834976186
    - type: nauc_precision_at_100_max
      value: 14.56627037716479
    - type: nauc_precision_at_100_std
      value: 61.40167189444594
    - type: nauc_precision_at_10_diff1
      value: 24.365479840589494
    - type: nauc_precision_at_10_max
      value: -2.708612191027584
    - type: nauc_precision_at_10_std
      value: -19.43242154430193
    - type: nauc_precision_at_1_diff1
      value: 33.380355990146
    - type: nauc_precision_at_1_max
      value: 12.83074393320823
    - type: nauc_precision_at_1_std
      value: -23.4424761925381
    - type: nauc_precision_at_20_diff1
      value: 20.473477308430237
    - type: nauc_precision_at_20_max
      value: -3.7772785312524912
    - type: nauc_precision_at_20_std
      value: -7.096694858556529
    - type: nauc_precision_at_3_diff1
      value: 28.334109781699112
    - type: nauc_precision_at_3_max
      value: -6.277807607594587
    - type: nauc_precision_at_3_std
      value: -40.62335017056855
    - type: nauc_precision_at_5_diff1
      value: 21.052413262881274
    - type: nauc_precision_at_5_max
      value: -15.720148003128722
    - type: nauc_precision_at_5_std
      value: -38.65755384255953
    - type: nauc_recall_at_1000_diff1
      value: 3.9912115667343886
    - type: nauc_recall_at_1000_max
      value: 2.3261787568338295
    - type: nauc_recall_at_1000_std
      value: 76.06780062528254
    - type: nauc_recall_at_100_diff1
      value: 5.859597648408654
    - type: nauc_recall_at_100_max
      value: -14.72466783682324
    - type: nauc_recall_at_100_std
      value: 28.835912273557618
    - type: nauc_recall_at_10_diff1
      value: 15.0046703019797
    - type: nauc_recall_at_10_max
      value: -12.61475085286235
    - type: nauc_recall_at_10_std
      value: -29.04758840050514
    - type: nauc_recall_at_1_diff1
      value: 21.156709083334775
    - type: nauc_recall_at_1_max
      value: -2.157834650647083
    - type: nauc_recall_at_1_std
      value: -30.794160263652802
    - type: nauc_recall_at_20_diff1
      value: 13.076618909825493
    - type: nauc_recall_at_20_max
      value: -18.0425193284075
    - type: nauc_recall_at_20_std
      value: -22.37479839545477
    - type: nauc_recall_at_3_diff1
      value: 17.013862570480683
    - type: nauc_recall_at_3_max
      value: -10.976230804308784
    - type: nauc_recall_at_3_std
      value: -39.6623780651685
    - type: nauc_recall_at_5_diff1
      value: 12.171847439522834
    - type: nauc_recall_at_5_max
      value: -17.29935794420055
    - type: nauc_recall_at_5_std
      value: -37.85648419874096
    - type: ndcg_at_1
      value: 31.633
    - type: ndcg_at_10
      value: 26.596999999999998
    - type: ndcg_at_100
      value: 38.242
    - type: ndcg_at_1000
      value: 49.999
    - type: ndcg_at_20
      value: 26.927
    - type: ndcg_at_3
      value: 26.354
    - type: ndcg_at_5
      value: 27.853
    - type: precision_at_1
      value: 32.653
    - type: precision_at_10
      value: 23.673
    - type: precision_at_100
      value: 7.878
    - type: precision_at_1000
      value: 1.5779999999999998
    - type: precision_at_20
      value: 17.143
    - type: precision_at_3
      value: 26.531
    - type: precision_at_5
      value: 28.571
    - type: recall_at_1
      value: 2.492
    - type: recall_at_10
      value: 17.328
    - type: recall_at_100
      value: 48.726
    - type: recall_at_1000
      value: 85.309
    - type: recall_at_20
      value: 24.214
    - type: recall_at_3
      value: 6.279999999999999
    - type: recall_at_5
      value: 10.656
---

## Introduction

We introduce  **NV-Retriever-v1**, an embedding model, which is optimized for retrieval. It achieves the highest score of **60.9** on 15 retrieval tasks within the MTEB retrieval benchmark (as of 12th July, 2024).

**This model is ready for non-commercial use.** 

For commercial use, the models of [NeMo Retriever Microservices (NIMs)](https://build.nvidia.com/explore/retrieval) may be used and are trained with the same techniques with different datasets. 

Technical details can be found in our paper: [NV-Retriever: Improving text embedding models with effective hard-negative mining](https://arxiv.org/abs/2407.15831)

## How to use

It is required to set `trust_remote_code=True` when loading the model, as it contains a custom module for bidirectional attention and applying the masked mean_pooling.

```python
import torch
from transformers import AutoTokenizer, AutoModel


tokenizer = AutoTokenizer.from_pretrained('nvidia/NV-Retriever-v1')
model = AutoModel.from_pretrained('nvidia/NV-Retriever-v1', trust_remote_code=True)

query_prefix = 'Given a web search query, retrieve relevant passages that answer the query: '
document_prefix = 'passage: '


queries = [
    "how much protein should a female eat",
    "summit define",
]
documents = [
    "As a general guideline, the CDC's average requirement of protein for women ages 19 to 70 is 46 grams per day. But, as you can see from this chart, you'll need to increase that if you're expecting or training for a marathon. Check out the chart below to see how much protein you should be eating each day.",
    "Definition of summit for English Language Learners. : 1  the highest point of a mountain : the top of a mountain. : 2  the highest level. : 3  a meeting or series of meetings between the leaders of two or more governments."
]
queries = [f"{query_prefix} {query}" for query in queries]
documents = [f"{document_prefix} {document}" for document in documents]


batch_queries = tokenizer(queries, padding=True, truncation=True, return_tensors='pt')
batch_documents = tokenizer(documents, padding=True, truncation=True, return_tensors='pt')

with torch.no_grad():
    embeddings_queries = model(**batch_queries)
    embeddings_documents = model(**batch_documents)


scores = (embeddings_queries @ embeddings_documents.T)
print(scores.tolist())
# [[0.6778843402862549, -0.03561091050505638], [-0.05117562413215637, 0.7305730581283569]]
```

## NV-Retriever-v1 Team:

* Mengyao Xu
* Gabriel Moreira
* Radek Osmulski
* Ronay Ak
* Benedikt Schifferer
* Even Oldridge

## Correspondence to
Benedikt Schifferer (bschifferer@nvidia.com)

## Citation

```
@misc{moreira2024nvretrieverimprovingtextembedding,
      title={NV-Retriever: Improving text embedding models with effective hard-negative mining}, 
      author={Gabriel de Souza P. Moreira and Radek Osmulski and Mengyao Xu and Ronay Ak and Benedikt Schifferer and Even Oldridge},
      year={2024},
      eprint={2407.15831},
      archivePrefix={arXiv},
      primaryClass={cs.IR},
      url={https://arxiv.org/abs/2407.15831}, 
}
```

## License

License to use this model is covered by the NVIDIA license agreement. By downloading the release version of the model, you accept the terms and conditions of these [licenses](https://huggingface.co/nvidia/NV-Retriever-v1/blob/main/LICENSE_NV_RETRIEVER.md) .
For each dataset a user elects to use, the user is responsible for checking if the dataset license is fit for the intended purpose.

## Troubleshooting

#### 1. Access to model nvidia/NV-Retriever-v1 is restricted. You must be authenticated to access it
Use your Hugging Face access token to execute `huggingface-cli login`. You can get a User Access Token from your Settings page. 

#### 2. Instruction Prompt Templates

NV-Retriever-v1 uses a query and document prefix similar to [Improving Text Embeddings with Large Language Models] (https://arxiv.org/pdf/2401.00368). It does not use the template with “Instruct:” and “Query:” ( f'Instruct: {task_description}\nQuery: {query}' ) it uses only “{task_description}: “. It is important to end the prefix with a colon (“:”) and a space. The document prefix for documents, “passage: ”,  is the same for every task. .

Example:
```
query = f{"Given a web search query, retrieve relevant passages that answer the query: {query}"}
document = f{"passage: {document}"}
```

#### 3. User Warning About Prompt

NV-Retriever-v1 expects Instruction Prompt Templates for each query and document. The custom code will modify the attention_mask to apply mean_pooling operation only on the actual text without the prefix. The custom code will look for the token_id 28747 and remove all attention prior to the first appearance of 28747.

As query and document require a prefix with the token_id 28747, the model will output a warning, if the token_id is not present in the input. It is likely that the model is used incorrectly.

Token_id 28747 is the character “:” not separated to some word. For example “query: ”, “passage: ” or “Represent this query: ”. If the input is “query :” with a space, the token_id for “:” is different. Note our custom code will find the first 28747 token in the input, so you don’t need to worry about the “:” inside the query or document content.

UserWarning: Input does not contain special token 28747 to mask out instruction prompt. Please check if prefix are applied, correctly
  warnings.warn(f"Input does not contain special token {sep_token_id} to mask out instruction prompt. Please check if prefix are applied, correctly")


#### 4. Multi-GPU support

NV-Retriever-v1 supports multi-GPU with DataParallel.

```
import torch

model = torch.nn.DataParallel(model).cuda()
````

## Intended use

The NV-Retriever Model is designed for users who need a high-performance embedding model for the retrieval task.

## Model Architecture

Architecture Type: Decoder-only bidirectional LLM<br>
Network Architecture: Mistral-7B-v0.1 with Bidirectional attention masking<br>
Pooling Type: Average (mean) pooling<br>
Embedding Dimension: 4096<br>
Max Input Tokens: 512<br>

The NV-Retriever-v1 Model is based on the Mistral-7B-v0.1 architecture with a bidirectional attention masking mechanism.

## Input

Input Type: Text<br>
Input Format: List of comma separated strings with task-specific instructions

## Output

Output Type: Floats<br>
Output Format: List of float arrays <br>
Other Properties Related to Output: Each array contains the embeddings of size 4096 for the corresponding input string

## Model Version(s)

NV-Retriever-v1

## Ethical Considerations

NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal supporting model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse. Please report security vulnerabilities or NVIDIA AI Concerns [here](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).



