MS MARCO Web Search: a Large-scale Information-rich Web Dataset with
  Millions of Real Click Labels
Recent breakthroughs in large models have highlighted the critical
significance of data scale, labels and modals. In this paper, we introduce MS
MARCO Web Search, the first large-scale information-rich web dataset, featuring
millions of real clicked query-document labels. This dataset closely mimics
real-world web document and query distribution, provides rich information for
various kinds of downstream tasks and encourages research in various areas,
such as generic end-to-end neural indexer models, generic embedding models, and
next generation information access system with large language models. MS MARCO
Web Search offers a retrieval benchmark with three web retrieval challenge
tasks that demand innovations in both machine learning and information
retrieval system research domains. As the first dataset that meets large, real
and rich data requirements, MS MARCO Web Search paves the way for future
advancements in AI and system research. MS MARCO Web Search dataset is
available at: https://github.com/microsoft/MS-MARCO-Web-Search.
6642e998af62c6c266aa541f
Qi Chen
6642e998af62c6c266aa5420
Xiubo Geng
6642e998af62c6c266aa5421
Corby Rosset
admin_assigned
2024-05-14T08:28:10.235Z
64ec43147e2ec711a761c594
/avatars/e4fc3de141ff026eee6eaa0b91d34ff1.svg
corby
user
corbyrosset
6642e998af62c6c266aa5422
Carolyn Buractaon
6642e998af62c6c266aa5423
Jingwen Lu
6642e998af62c6c266aa5424
Tao Shen
admin_assigned
2024-05-14T08:29:10.835Z
602331cdc1f3c79f98e4b378
/avatars/fbcf4ac9059df87ee788dc431f46606a.svg
Tao Shen
user
taoshen58
6642e998af62c6c266aa5425
Kun Zhou
claimed_verified
2025-04-23T08:40:35.767Z
66f4fcbc29b10ae4c990a2e0
/avatars/5d6df3aa5792a031c28274d428c46d84.svg
Kun Zhou
user
FrancisKunZhou
6642e998af62c6c266aa5426
Chenyan Xiong
admin_assigned
2024-05-14T08:30:29.074Z
617ae49bc0ff6006217aa22e
https://cdn-avatars.huggingface.co/v1/production/uploads/1635543252231-617ae49bc0ff6006217aa22e.jpeg
Chenyan Xiong
user
xiongchenyan
6642e998af62c6c266aa5427
Yeyun Gong
admin_assigned
2024-05-14T08:30:57.752Z
643f615aa16cd6d1f4c581de
/avatars/47753a3e82b44f81881600c52e1e8495.svg
Yeyun Gong
user
yegong
6642e998af62c6c266aa5428
Paul Bennett
6642e998af62c6c266aa5429
Nick Craswell
6642e998af62c6c266aa542a
Xing Xie
admin_assigned
2024-05-14T08:32:07.153Z
64785ca82b3730b6b63b75a2
/avatars/b0c4f7fb4d4c556118fa6b52d3615429.svg
Xing Xie
user
xingustc
6642e998af62c6c266aa542b
Fan Yang
6642e998af62c6c266aa542c
Bryan Tower
6642e998af62c6c266aa542d
Nikhil Rao
claimed_verified
2025-05-29T07:47:51.835Z
68377cd94d2784008f519993
/avatars/ea30ce393706e5167fe03b79ded94939.svg
Nikhil Rao
user
theclairvoyant
6642e998af62c6c266aa542e
Anlei Dong
6642e998af62c6c266aa542f
Wenqi Jiang
admin_assigned
2024-05-14T08:33:16.464Z
64004d45a3b8fe3ac0e8469d
/avatars/d3dd9637e2dd725626c779d27905482c.svg
Wenqi Jiang
user
wenqij
6642e998af62c6c266aa5430
Zheng Liu
6642e998af62c6c266aa5431
Mingqin Li
6642e998af62c6c266aa5432
Chuanjie Liu
admin_assigned
2024-05-14T08:33:54.003Z
6528b76d0b44378dcc54ec60
/avatars/0943b4c7def02c1751e163aa758ccec5.svg
Chuanjie Liu
user
chuanjieliu
6642e998af62c6c266aa5433
Zengzhong Li
6642e998af62c6c266aa5434
Rangan Majumder
admin_assigned
2024-05-14T08:34:07.277Z
64851c3610e6b874559ef7ae
/avatars/2847eb17a5fa45c93280d4224c33ddf0.svg
Rangan Majumder
user
Rangosaur
6642e998af62c6c266aa5435
Jennifer Neville
6642e998af62c6c266aa5436
Andy Oakley
admin_assigned
2024-05-14T08:34:18.710Z
630c42b0cd26ad7f60e047d5
/avatars/2707066c2113ad03b24f12bf45b5fe35.svg
Andy Oakley
user
andyoakley
6642e998af62c6c266aa5437
Knut Magne Risvik
6642e998af62c6c266aa5438
Harsha Vardhan Simhadri
6642e998af62c6c266aa5439
Manik Varma
6642e998af62c6c266aa543a
Yujing Wang
admin_assigned
2024-05-14T08:34:38.076Z
6412e09e8c9885e10298d57f
/avatars/0f748c80ba3cc3e8fcb40b284ec20b47.svg
yujingwang
user
wangyujing1234
6642e998af62c6c266aa543b
Linjun Yang
admin_assigned
2024-05-14T08:34:44.682Z
641db563c9ce8fdbce4eaa86
/avatars/ec4012d12a56cba5e27c9eaf58fc7691.svg
Linjun Yang
user
Wadeyang
6642e998af62c6c266aa543c
Mao Yang
6642e998af62c6c266aa543d
Ce Zhang
MS MARCO Web Search: a Large-scale Information-rich Web Dataset with
  Millions of Real Click Labels
Recent breakthroughs in large models have highlighted the critical
significance of data scale, labels and modals. In this paper, we introduce MS
MARCO Web Search, the first large-scale information-rich web dataset, featuring
millions of real clicked query-document labels. This dataset closely mimics
real-world web document and query distribution, provides rich information for
various kinds of downstream tasks and encourages research in various areas,
such as generic end-to-end neural indexer models, generic embedding models, and
next generation information access system with large language models. MS MARCO
Web Search offers a retrieval benchmark with three web retrieval challenge
tasks that demand innovations in both machine learning and information
retrieval system research domains. As the first dataset that meets large, real
and rich data requirements, MS MARCO Web Search paves the way for future
advancements in AI and system research. MS MARCO Web Search dataset is
available at: https://github.com/microsoft/MS-MARCO-Web-Search.
MS MARCO Web Search provides a large-scale, information-rich web dataset with real-world query-document labels for training and evaluating neural indexer models, embedding models, and information access systems.
generic end-to-end neural indexer models generic embedding models next generation information access system large language models retrieval benchmark web retrieval challenge tasks machine learning information retrieval system research