8 19 78

Nandan Thakur

nthakur

akontra's profile picture

kenchan0226's profile picture

Bayparkbear's profile picture

https://thakur-nandan.github.io

nandan__thakur
thakur-nandan

AI & ML interests

NLP, IR, QA

Recent Activity

liked a Space 3 days ago

crystina-z/multilingual-paperbase

updated a dataset 3 days ago

nthakur/search-arena-v1-nuggets-with-urls-5k-qwen

published a dataset 3 days ago

nthakur/search-arena-v1-nuggets-with-urls-5k-qwen

View all activity

Organizations

nthakur 's collections 5

🏜️MIRAGE-Bench [NAACL'25]

Dataset Collection from the MIRAGE-Bench paper

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems

Paper • 2410.13716 • Published Oct 17, 2024
nthakur/mirage-bench

Viewer • Updated Jun 10, 2024 • 13k • 71 • 3
nthakur/mirage-bench-output

Viewer • Updated Mar 21 • 10k • 18 • 1
nthakur/mirage-bench-pairwise-judgments

Viewer • Updated Mar 21 • 299k • 10 • 1

🌐 NoMIRACL Dataset [EMNLP'24]

A collection of multilingual relevance assessment datasets. We also have SFT fine-tuned models (Mistral-7B & Llama-3 8B)

NoMIRACL: Knowing When You Don't Know for Robust Multilingual Retrieval-Augmented Generation

Paper • 2312.11361 • Published Dec 18, 2023 • 1
miracl/nomiracl

Updated Nov 23, 2024 • 247 • 12
miracl/nomiracl-instruct

Viewer • Updated Nov 23, 2024 • 23.9k • 30 • 2
miracl/miracl-corpus

Viewer • Updated Jan 5, 2023 • 77.2M • 2.96k • 46

GPL BEIR Datasets [NAACL'22]

Generative Pseudo Labeling training datasets for all domains in BEIR.

GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval

Paper • 2112.07577 • Published Dec 14, 2021
nthakur/gpl-trec-covid

Viewer • Updated Nov 25, 2023 • 230k • 7 • 1
nthakur/gpl-nfcorpus

Viewer • Updated Nov 24, 2023 • 221k • 30 • 1
nthakur/gpl-nq

Viewer • Updated Dec 1, 2023 • 239k • 19 • 1

Multilingual SFT & DPO Datasets

These SFT or DPO datasets were translated from English using the Mistral-7B-Instruct-v0.2 or taken from other sources.

nthakur/multilingual-deita-10k-v0-sft-v0.1

Viewer • Updated Aug 9, 2024 • 24.4k • 12
nthakur/Bactrian-X-23-lang-instruct

Viewer • Updated Mar 21, 2024 • 1.54M • 18
nthakur/GSM8KInstruct-Parallel-instruct

Viewer • Updated Mar 21, 2024 • 73.6k • 13
nthakur/ultrachat-200k-instruct

Viewer • Updated Mar 21, 2024 • 231k • 9

🦢SWIM-IR Dataset [NAACL'24]

29 million Synthetic Wikipedia-based Multilingual Retrieval Training Pairs.

Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval

Paper • 2311.05800 • Published Nov 10, 2023 • 4
nthakur/swim-ir-cross-lingual

Viewer • Updated Apr 28, 2024 • 15.4M • 201 • 8
nthakur/swim-ir-monolingual

Viewer • Updated Apr 28, 2024 • 3.17M • 222 • 9
nthakur/indic-swim-ir-cross-lingual

Viewer • Updated Apr 28, 2024 • 93k • 76 • 2

🏜️MIRAGE-Bench [NAACL'25]

Dataset Collection from the MIRAGE-Bench paper

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems

Paper • 2410.13716 • Published Oct 17, 2024
nthakur/mirage-bench

Viewer • Updated Jun 10, 2024 • 13k • 71 • 3
nthakur/mirage-bench-output

Viewer • Updated Mar 21 • 10k • 18 • 1
nthakur/mirage-bench-pairwise-judgments

Viewer • Updated Mar 21 • 299k • 10 • 1

Multilingual SFT & DPO Datasets

These SFT or DPO datasets were translated from English using the Mistral-7B-Instruct-v0.2 or taken from other sources.

nthakur/multilingual-deita-10k-v0-sft-v0.1

Viewer • Updated Aug 9, 2024 • 24.4k • 12
nthakur/Bactrian-X-23-lang-instruct

Viewer • Updated Mar 21, 2024 • 1.54M • 18
nthakur/GSM8KInstruct-Parallel-instruct

Viewer • Updated Mar 21, 2024 • 73.6k • 13
nthakur/ultrachat-200k-instruct

Viewer • Updated Mar 21, 2024 • 231k • 9

🌐 NoMIRACL Dataset [EMNLP'24]

A collection of multilingual relevance assessment datasets. We also have SFT fine-tuned models (Mistral-7B & Llama-3 8B)

NoMIRACL: Knowing When You Don't Know for Robust Multilingual Retrieval-Augmented Generation

Paper • 2312.11361 • Published Dec 18, 2023 • 1
miracl/nomiracl

Updated Nov 23, 2024 • 247 • 12
miracl/nomiracl-instruct

Viewer • Updated Nov 23, 2024 • 23.9k • 30 • 2
miracl/miracl-corpus

Viewer • Updated Jan 5, 2023 • 77.2M • 2.96k • 46

🦢SWIM-IR Dataset [NAACL'24]

29 million Synthetic Wikipedia-based Multilingual Retrieval Training Pairs.

Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval

Paper • 2311.05800 • Published Nov 10, 2023 • 4
nthakur/swim-ir-cross-lingual

Viewer • Updated Apr 28, 2024 • 15.4M • 201 • 8
nthakur/swim-ir-monolingual

Viewer • Updated Apr 28, 2024 • 3.17M • 222 • 9
nthakur/indic-swim-ir-cross-lingual

Viewer • Updated Apr 28, 2024 • 93k • 76 • 2

GPL BEIR Datasets [NAACL'22]

Generative Pseudo Labeling training datasets for all domains in BEIR.

GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval

Paper • 2112.07577 • Published Dec 14, 2021
nthakur/gpl-trec-covid

Viewer • Updated Nov 25, 2023 • 230k • 7 • 1
nthakur/gpl-nfcorpus

Viewer • Updated Nov 24, 2023 • 221k • 30 • 1
nthakur/gpl-nq

Viewer • Updated Dec 1, 2023 • 239k • 19 • 1