Table 12: In-domain results. “target pre-train” refers to intermediate pre-training on the target corpus
before supervised ﬁne-tuning. For NQ, we use the passage retrieval setting from DPR [30].

target pre-train?

ANCE [61]
RocketQAv2 [50]
SimLM [58]
E5small
E5base
E5large

(cid:55)
(cid:55)
(cid:51)
(cid:55)
(cid:55)
(cid:55)

MS-MARCO

MRR@10 R@1k
95.9
98.1
98.7
98.1
98.5
98.7

33.0
38.8
41.1
37.5
38.5
39.4

NQ

R@20 R@100
81.9
83.7
85.2
84.6
86.1
86.4

87.5
89.0
89.7
89.8
90.7
90.5

C Negative Results
E5