GEM benchmark

https://gem-benchmark.com

Activity Feed Request to join this org

AI & ML interests

We develop infrastructure for the evaluation of generated text.

Recent Activity

gentaiscool authored a paper 1 day ago

Language Surgery in Multilingual Large Language Models

1024m authored a paper 26 days ago

Uncovering Cultural Representation Disparities in Vision-Language Models

Krystalan authored a paper about 1 month ago

ExTrans: Multilingual Deep Reasoning Translation via Exemplar-Enhanced Reinforcement Learning

View all activity

GEM 's datasets 44

GEM/xlsum

Updated Oct 3, 2024 • 2.77k • 5

GEM/wiki_auto_asset_turk

Viewer • Updated May 29, 2024 • 510k • 669 • 8

GEM/gem

Updated Jan 18, 2024 • 4.34k • 31

GEM/opusparcus

Updated Jan 9, 2024 • 1.01k • 1

GEM/Augmented_CACAPO_for_E2E

Viewer • Updated Feb 26, 2023 • 47.3k • 31

GEM/CACAPO_E2E

Viewer • Updated Feb 26, 2023 • 20.1k • 39

GEM/Elongated_CACAPO_for_E2E

Updated Feb 26, 2023 • 153

GEM/xwikis

Updated Feb 22, 2023 • 1.88k • 4

GEM/wiki_lingua

Updated Feb 16, 2023 • 2.19k • 48

GEM/xmediasum

Viewer • Updated Feb 15, 2023 • 40k • 18 • 4

GEM/TaTA

Viewer • Updated Nov 3, 2022 • 8.69k • 24 • 1

GEM/FairytaleQA

Viewer • Updated Oct 25, 2022 • 10.6k • 342 • 9

GEM/squality

Updated Oct 25, 2022 • 119 • 1

GEM/xsum

Updated Oct 24, 2022 • 164 • 2

GEM/wiki_cat_sum

Viewer • Updated Oct 24, 2022 • 187k • 1.14k • 4

GEM/web_nlg

Viewer • Updated Oct 24, 2022 • 58.9k • 521 • 2

GEM/viggo

Viewer • Updated Oct 24, 2022 • 8.84k • 815 • 33

GEM/turku_hockey_data2text

Updated Oct 24, 2022 • 315

GEM/totto

Viewer • Updated Oct 24, 2022 • 138k • 301 • 2

GEM/surface_realisation_st_2020

Viewer • Updated Oct 24, 2022 • 351k • 1.75k • 1

GEM/squad_v2

Viewer • Updated Oct 24, 2022 • 142k • 489 • 2

GEM/sportsett_basketball

Viewer • Updated Oct 24, 2022 • 6.15k • 283 • 11

GEM/schema_guided_dialog

Viewer • Updated Oct 24, 2022 • 188k • 264 • 7

GEM/mlsum

Viewer • Updated Oct 24, 2022 • 535k • 193 • 2

GEM/mlb_data_to_text

Viewer • Updated Oct 24, 2022 • 26.2k • 259 • 3

GEM/e2e_nlg

Viewer • Updated Oct 24, 2022 • 38.4k • 167 • 1

GEM/dstc10_track2_task2

Updated Oct 24, 2022 • 126 • 4

GEM/dart

Viewer • Updated Oct 24, 2022 • 70.5k • 157

GEM/cs_restaurants

Viewer • Updated Oct 24, 2022 • 6.69k • 178 • 1

GEM/conversational_weather

Updated Oct 24, 2022 • 353 • 4