Humanity's Last Exam
Benchmarks are important tools for tracking the rapid advancements in large
language model (LLM) capabilities. However, benchmarks are not keeping pace in
difficulty: LLMs now achieve over 90\% accuracy on popular benchmarks like
MMLU, limiting informed measurement of state-of-the-art LLM capabilities. In
response, we introduce Humanity's Last Exam (HLE), a multi-modal benchmark at
the frontier of human knowledge, designed to be the final closed-ended academic
benchmark of its kind with broad subject coverage. HLE consists of 3,000
questions across dozens of subjects, including mathematics, humanities, and the
natural sciences. HLE is developed globally by subject-matter experts and
consists of multiple-choice and short-answer questions suitable for automated
grading. Each question has a known solution that is unambiguous and easily
verifiable, but cannot be quickly answered via internet retrieval.
State-of-the-art LLMs demonstrate low accuracy and calibration on HLE,
highlighting a significant gap between current LLM capabilities and the expert
human frontier on closed-ended academic questions. To inform research and
policymaking upon a clear understanding of model capabilities, we publicly
release HLE at https://lastexam.ai.
679704b422b334a8370d3572
Long Phan
679704b422b334a8370d3573
Alice Gatti
admin_assigned
2025-01-27T14:52:50.410Z
64b6bd94047fd5611593694a
/avatars/9dc8dd0229fa0467a1414b9f5ebbab0d.svg
Alice Gatti
user
alicegatti
679704b422b334a8370d3574
Ziwen Han
admin_assigned
2025-01-27T14:52:59.398Z
62ed40fe9b538d02b451c211
/avatars/d5486b050fd63ade348158e64a3e5ff7.svg
Han
user
Ziwen
679704b422b334a8370d3575
Nathaniel Li
679704b422b334a8370d3576
Josephina Hu
admin_assigned
2025-01-27T14:53:15.392Z
66b13ca5c8900ac0175a7bc5
/avatars/90e2c55145b1ee94fb6ef54426dfcdaa.svg
Josephina Hu
user
lovejosaay
679704b422b334a8370d3577
Hugh Zhang
admin_assigned
2025-01-27T14:53:24.388Z
65d6a5f94c28026a003581b4
/avatars/c24c314eafbf6a885c586258ae87a47f.svg
Hugh Zhang
user
hugh-scale
679704b422b334a8370d3578
Sean Shi
admin_assigned
2025-01-27T14:53:30.447Z
66590a222d857c7a34771880
/avatars/e6ff7d1b68feffe8953a62da380a60c8.svg
Sean Shi
user
seanshi-scale
679704b422b334a8370d3579
Michael Choi
679704b422b334a8370d357a
Anish Agrawal
679704b422b334a8370d357b
Arnav Chopra
679704b422b334a8370d357c
Adam Khoja
679704b422b334a8370d357d
Ryan Kim
679704b422b334a8370d357e
Jason Hausenloy
admin_assigned
2025-01-27T14:54:24.451Z
6732f99ce6a45b6a0b322702
/avatars/91a3266fe3f1a4c822739d9baba53c68.svg
Jason Hausenloy
user
jasonhausenloy
679704b422b334a8370d357f
Oliver Zhang
679704b422b334a8370d3580
Mantas Mazeika
admin_assigned
2025-01-27T14:54:56.624Z
622bbdeb47e49335b2128a06
/avatars/acaa6792da1a79a1ba91bbd148c85087.svg
Mantas Mazeika
user
mmazeika
679704b422b334a8370d3581
Daron Anderson
679704b422b334a8370d3582
Tung Nguyen
679704b422b334a8370d3583
Mobeen Mahmood
679704b422b334a8370d3584
Fiona Feng
679704b422b334a8370d3585
Steven Y. Feng
679704b422b334a8370d3586
Haoran Zhao
679704b422b334a8370d3587
Michael Yu
679704b422b334a8370d3588
Varun Gangal
admin_assigned
2025-01-27T14:55:42.966Z
617ac050ff689804c90eca49
https://cdn-avatars.huggingface.co/v1/production/uploads/1635434570481-noauth.jpeg
Varun Gangal
user
vgtomahawk
679704b422b334a8370d3589
Chelsea Zou
679704b422b334a8370d358a
Zihan Wang
679704b422b334a8370d358b
Jessica P. Wang
679704b422b334a8370d358c
Pawan Kumar
679704b422b334a8370d358d
Oleksandr Pokutnyi
679704b422b334a8370d358e
Robert Gerbicz
679704b422b334a8370d358f
Serguei Popov
679704b422b334a8370d3590
John-Clark Levin
679704b422b334a8370d3591
Mstyslav Kazakov
679704b422b334a8370d3592
Johannes Schmitt
679704b422b334a8370d3593
Geoff Galgon
679704b422b334a8370d3594
Alvaro Sanchez
679704b422b334a8370d3595
Yongki Lee
679704b422b334a8370d3596
Will Yeadon
679704b422b334a8370d3597
Scott Sauers
679704b422b334a8370d3598
Marc Roth
679704b422b334a8370d3599
Chidozie Agu
679704b422b334a8370d359a
Søren Riis
679704b422b334a8370d359b
Fabian Giska
679704b422b334a8370d359c
Saiteja Utpala
679704b422b334a8370d359d
Zachary Giboney
679704b422b334a8370d359e
Gashaw M. Goshu
679704b422b334a8370d359f
Joan of Arc Xavier
679704b422b334a8370d35a0
Sarah-Jane Crowson
679704b422b334a8370d35a1
Mohinder Maheshbhai Naiya
679704b422b334a8370d35a2
Noah Burns
679704b422b334a8370d35a3
Lennart Finke
claimed_verified
2025-03-12T08:50:19.990Z
66d823d3b61dd110220f80c3
https://cdn-avatars.huggingface.co/v1/production/uploads/66d823d3b61dd110220f80c3/ZiO99MNnWe3c-OnVWV-QB.png
Lennart Finke
user
lennart-finke
679704b422b334a8370d35a4
Zerui Cheng
claimed_verified
2025-03-18T08:12:15.422Z
67d8e5f041fc44bb16e5468c
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/jUCe0rf7Z-cF51OC5Iczn.png
Zerui Cheng
user
ZeruiCheng
679704b422b334a8370d35a5
Hyunwoo Park
679704b422b334a8370d35a6
Francesco Fournier-Facio
679704b422b334a8370d35a7
John Wydallis
679704b422b334a8370d35a8
Mark Nandor
679704b422b334a8370d35a9
Ankit Singh
679704b422b334a8370d35aa
Tim Gehrunger
679704b422b334a8370d35ab
Jiaqi Cai
679704b422b334a8370d35ac
Ben McCarty
679704b422b334a8370d35ad
Darling Duclosel
679704b422b334a8370d35ae
Jungbae Nam
679704b422b334a8370d35af
Jennifer Zampese
679704b422b334a8370d35b0
Ryan G. Hoerr
679704b422b334a8370d35b1
Aras Bacho
679704b422b334a8370d35b2
Gautier Abou Loume
679704b422b334a8370d35b3
Abdallah Galal
679704b422b334a8370d35b4
Hangrui Cao
679704b422b334a8370d35b5
Alexis C Garretson
679704b422b334a8370d35b6
Damien Sileo
679704b422b334a8370d35b7
Qiuyu Ren
679704b422b334a8370d35b8
Doru Cojoc
679704b422b334a8370d35b9
Pavel Arkhipov
679704b422b334a8370d35ba
Usman Qazi
679704b422b334a8370d35bb
Lianghui Li
679704b422b334a8370d35bc
Sumeet Motwani
679704b422b334a8370d35bd
Christian Schroeder de Witt
679704b422b334a8370d35be
Edwin Taylor
679704b422b334a8370d35bf
Johannes Veith
679704b422b334a8370d35c0
Eric Singer
679704b422b334a8370d35c1
Taylor D. Hartman
679704b422b334a8370d35c2
Paolo Rissone
679704b422b334a8370d35c3
Jaehyeok Jin
679704b422b334a8370d35c4
Jack Wei Lun Shi
679704b422b334a8370d35c5
Chris G. Willcocks
679704b422b334a8370d35c6
Joshua Robinson
679704b422b334a8370d35c7
Aleksandar Mikov
679704b422b334a8370d35c8
Ameya Prabhu
claimed_verified
2025-02-27T12:55:03.605Z
6464a0d41683d3c81f51924a
https://cdn-avatars.huggingface.co/v1/production/uploads/6464a0d41683d3c81f51924a/s7yYVwfUB4WOhVFJS6A6T.jpeg
Ameya Prabhu
user
AmeyaPrabhu
679704b422b334a8370d35c9
Longke Tang
679704b422b334a8370d35ca
Xavier Alapont
679704b422b334a8370d35cb
Justine Leon Uro
679704b422b334a8370d35cc
Kevin Zhou
679704b422b334a8370d35cd
Emily de Oliveira Santos
679704b422b334a8370d35ce
Andrey Pupasov Maksimov
679704b422b334a8370d35cf
Edward Vendrow
679704b422b334a8370d35d0
Kengo Zenitani
679704b422b334a8370d35d1
Julien Guillod
679704b422b334a8370d35d2
Yuqi Li
679704b422b334a8370d35d3
Joshua Vendrow
679704b422b334a8370d35d4
Vladyslav Kuchkin
679704b422b334a8370d35d5
Ng Ze-An
679704b422b334a8370d35d6
Pierre Marion
679704b422b334a8370d35d7
Denis Efremov
679704b422b334a8370d35d8
Jayson Lynch
679704b422b334a8370d35d9
Kaiqu Liang
679704b422b334a8370d35da
Andrew Gritsevskiy
679704b422b334a8370d35db
Dakotah Martinez
679704b422b334a8370d35dc
Ben Pageler
679704b422b334a8370d35dd
Nick Crispino
679704b422b334a8370d35de
Dimitri Zvonkine
679704b422b334a8370d35df
Natanael Wildner Fraga
679704b422b334a8370d35e0
Saeed Soori
679704b422b334a8370d35e1
Ori Press
679704b422b334a8370d35e2
Henry Tang
679704b422b334a8370d35e3
Julian Salazar
679704b422b334a8370d35e4
Sean R. Green
679704b422b334a8370d35e5
Lina Brüssel
679704b422b334a8370d35e6
Moon Twayana
679704b422b334a8370d35e7
Aymeric Dieuleveut
679704b422b334a8370d35e8
T. Ryan Rogers
679704b422b334a8370d35e9
Wenjin Zhang
679704b422b334a8370d35ea
Bikun Li
679704b422b334a8370d35eb
Jinzhou Yang
679704b422b334a8370d35ec
Arun Rao
679704b422b334a8370d35ed
Gabriel Loiseau
claimed_verified
2025-07-11T08:21:00.605Z
661d6d36a3e99b518d6b9a71
/avatars/4135e3ce0ae64dc62ccabf1e534f98bd.svg
Gabriel Loiseau
user
gabrielloiseau
679704b422b334a8370d35ee
Mikhail Kalinin
679704b422b334a8370d35ef
Marco Lukas
679704b422b334a8370d35f0
Ciprian Manolescu
679704b422b334a8370d35f1
Subrata Mishra
679704b422b334a8370d35f2
Ariel Ghislain Kemogne Kamdoum
679704b422b334a8370d35f3
Tobias Kreiman
679704b422b334a8370d35f4
Tad Hogg
679704b422b334a8370d35f5
Alvin Jin
679704b422b334a8370d35f6
Carlo Bosio
679704b422b334a8370d35f7
Gongbo Sun
679704b422b334a8370d35f8
Brian P Coppola
679704b422b334a8370d35f9
Tim Tarver
679704b422b334a8370d35fa
Haline Heidinger
679704b422b334a8370d35fb
Rafael Sayous
679704b422b334a8370d35fc
Stefan Ivanov
679704b422b334a8370d35fd
Joseph M Cavanagh
679704b422b334a8370d35fe
Jiawei Shen
679704b422b334a8370d35ff
Joseph Marvin Imperial
679704b422b334a8370d3600
Philippe Schwaller
679704b422b334a8370d3601
Shaipranesh Senthilkuma
679704b422b334a8370d3602
Andres M Bran
679704b422b334a8370d3603
Ali Dehghan
679704b422b334a8370d3604
Andres Algaba
679704b422b334a8370d3605
Brecht Verbeken
679704b422b334a8370d3606
David Noever
claimed_verified
2025-01-28T10:10:21.620Z
63136a82e29fb2e86d5e5bdd
https://cdn-avatars.huggingface.co/v1/production/uploads/63136a82e29fb2e86d5e5bdd/pFZDuQtzfUStovbwwZGvn.png
David Noever
user
dnoever
679704b422b334a8370d3607
Ragavendran P V
679704b422b334a8370d3608
Lisa Schut
679704b422b334a8370d3609
Ilia Sucholutsky
679704b422b334a8370d360a
Evgenii Zheltonozhskii
679704b422b334a8370d360b
Derek Lim
679704b422b334a8370d360c
Richard Stanley
679704b422b334a8370d360d
Shankar Sivarajan
679704b422b334a8370d360e
Tong Yang
679704b422b334a8370d360f
John Maar
679704b422b334a8370d3610
Julian Wykowski
679704b422b334a8370d3611
Martí Oller
679704b422b334a8370d3612
Jennifer Sandlin
679704b422b334a8370d3613
Anmol Sahu
679704b422b334a8370d3614
Yuzheng Hu
679704b422b334a8370d3615
Sara Fish
679704b422b334a8370d3616
Nasser Heydari
679704b422b334a8370d3617
Archimedes Apronti
679704b422b334a8370d3618
Kaivalya Rawal
679704b422b334a8370d3619
Tobias Garcia Vilchis
679704b422b334a8370d361a
Yuexuan Zu
679704b422b334a8370d361b
Martin Lackner
679704b422b334a8370d361c
James Koppel
679704b422b334a8370d361d
Jeremy Nguyen
679704b422b334a8370d361e
Daniil S. Antonenko
679704b422b334a8370d361f
Steffi Chern
679704b422b334a8370d3620
Bingchen Zhao
claimed_verified
2025-01-28T10:10:25.495Z
62dcd71075e9787ec5aa41ba
/avatars/f37ce036b76180ed0fa004f9c8c09363.svg
Bingchen Zhao
user
tennant
679704b422b334a8370d3621
Pierrot Arsene
679704b422b334a8370d3622
Alan Goldfarb
679704b422b334a8370d3623
Sergey Ivanov
679704b422b334a8370d3624
Rafał Poświata
claimed_verified
2025-01-28T10:10:27.365Z
63933543f8b4767ae646e8a1
https://cdn-avatars.huggingface.co/v1/production/uploads/1670591762482-noauth.png
Rafał Poświata
user
rafalposwiata
679704b422b334a8370d3625
Chenguang Wang
679704b422b334a8370d3626
Daofeng Li
679704b422b334a8370d3627
Donato Crisostomi
679704b422b334a8370d3628
Andrea Achilleos
679704b422b334a8370d3629
Benjamin Myklebust
679704b422b334a8370d362a
Archan Sen
679704b422b334a8370d362b
David Perrella
679704b422b334a8370d362c
Nurdin Kaparov
679704b422b334a8370d362d
Mark H Inlow
679704b422b334a8370d362e
Allen Zang
679704b422b334a8370d362f
Elliott Thornley
679704b422b334a8370d3630
Daniil Orel
679704b422b334a8370d3631
Vladislav Poritski
679704b422b334a8370d3632
Shalev Ben-David
679704b422b334a8370d3633
Zachary Berger
679704b422b334a8370d3634
Parker Whitfill
679704b422b334a8370d3635
Michael Foster
679704b422b334a8370d3636
Daniel Munro
679704b422b334a8370d3637
Linh Ho
679704b422b334a8370d3638
Dan Bar Hava
679704b422b334a8370d3639
Aleksey Kuchkin
679704b422b334a8370d363a
Robert Lauff
679704b422b334a8370d363b
David Holmes
679704b422b334a8370d363c
Frank Sommerhage
679704b422b334a8370d363d
Keith Schneider
679704b422b334a8370d363e
Zakayo Kazibwe
679704b422b334a8370d363f
Nate Stambaugh
679704b422b334a8370d3640
Mukhwinder Singh
679704b422b334a8370d3641
Ilias Magoulas
679704b422b334a8370d3642
Don Clarke
679704b422b334a8370d3643
Dae Hyun Kim
679704b422b334a8370d3644
Felipe Meneguitti Dias
679704b422b334a8370d3645
Veit Elser
679704b422b334a8370d3646
Kanu Priya Agarwal
679704b422b334a8370d3647
Victor Efren Guadarrama Vilchis
679704b422b334a8370d3648
Immo Klose
679704b422b334a8370d3649
Christoph Demian
679704b422b334a8370d364a
Ujjwala Anantheswaran
679704b422b334a8370d364b
Adam Zweiger
679704b422b334a8370d364c
Guglielmo Albani
679704b422b334a8370d364d
Jeffery Li
679704b422b334a8370d364e
Nicolas Daans
679704b422b334a8370d364f
Maksim Radionov
679704b422b334a8370d3650
Václav Rozhoň
679704b422b334a8370d3651
Ziqiao Ma
claimed_verified
2025-02-27T22:09:25.436Z
630cfc45b66f088d547b2768
https://cdn-avatars.huggingface.co/v1/production/uploads/630cfc45b66f088d547b2768/ge2BZLDYeTlpnlIlraHNw.png
Martin Ziqiao Ma
user
marstin
679704b422b334a8370d3652
Christian Stump
679704b422b334a8370d3653
Mohammed Berkani
679704b422b334a8370d3654
Jacob Platnick
679704b422b334a8370d3655
Volodymyr Nevirkovets
679704b422b334a8370d3656
Luke Basler
679704b422b334a8370d3657
Marco Piccardo
679704b422b334a8370d3658
Ferenc Jeanplong
679704b422b334a8370d3659
Niv Cohen
679704b422b334a8370d365a
Josef Tkadlec
679704b422b334a8370d365b
Paul Rosu
679704b422b334a8370d365c
Piotr Padlewski
679704b422b334a8370d365d
Stanislaw Barzowski
679704b422b334a8370d365e
Kyle Montgomery
679704b422b334a8370d365f
Aline Menezes
679704b422b334a8370d3660
Arkil Patel
claimed_verified
2025-02-24T09:26:54.744Z
631a523c04f8ed65eff16fb4
/avatars/2b284403c88f140d7bef283f729f7a3e.svg
Arkil Patel
user
arkilpatel
679704b422b334a8370d3661
Zixuan Wang
679704b422b334a8370d3662
Jamie Tucker-Foltz
679704b422b334a8370d3663
Jack Stade
679704b422b334a8370d3664
Tom Goertzen
679704b422b334a8370d3665
Fereshteh Kazemi
679704b422b334a8370d3666
Jeremiah Milbauer
679704b422b334a8370d3667
John Arnold Ambay
679704b422b334a8370d3668
Abhishek Shukla
679704b422b334a8370d3669
Yan Carlos Leyva Labrador
679704b422b334a8370d366a
Alan Givré
679704b422b334a8370d366b
Hew Wolff
679704b422b334a8370d366c
Vivien Rossbach
679704b422b334a8370d366d
Muhammad Fayez Aziz
679704b422b334a8370d366e
Younesse Kaddar
679704b422b334a8370d366f
Yanxu Chen
679704b422b334a8370d3670
Robin Zhang
679704b422b334a8370d3671
Jiayi Pan
679704b422b334a8370d3672
Antonio Terpin
679704b422b334a8370d3673
Niklas Muennighoff
679704b422b334a8370d3674
Hailey Schoelkopf
679704b422b334a8370d3675
Eric Zheng
679704b422b334a8370d3676
Avishy Carmi
679704b422b334a8370d3677
Adam Jones
679704b422b334a8370d3678
Jainam Shah
679704b422b334a8370d3679
Ethan D. L. Brown
679704b422b334a8370d367a
Kelin Zhu
679704b422b334a8370d367b
Max Bartolo
679704b422b334a8370d367c
Richard Wheeler
679704b422b334a8370d367d
Andrew Ho
679704b422b334a8370d367e
Shaul Barkan
679704b422b334a8370d367f
Jiaqi Wang
679704b422b334a8370d3680
Martin Stehberger
679704b422b334a8370d3681
Egor Kretov
679704b422b334a8370d3682
Kaustubh Sridhar
679704b422b334a8370d3683
Zienab EL-Wasif
679704b422b334a8370d3684
Anji Zhang
679704b422b334a8370d3685
Daniel Pyda
679704b422b334a8370d3686
Joanna Tam
679704b422b334a8370d3687
David M. Cunningham
679704b422b334a8370d3688
Vladimir Goryachev
679704b422b334a8370d3689
Demosthenes Patramanis
679704b422b334a8370d368a
Michael Krause
679704b422b334a8370d368b
Andrew Redenti
679704b422b334a8370d368c
Daniel Bugas
679704b422b334a8370d368d
David Aldous
679704b422b334a8370d368e
Jesyin Lai
679704b422b334a8370d368f
Shannon Coleman
679704b422b334a8370d3690
Mohsen Bahaloo
679704b422b334a8370d3691
Jiangnan Xu
679704b422b334a8370d3692
Sangwon Lee
679704b422b334a8370d3693
Sandy Zhao
679704b422b334a8370d3694
Ning Tang
679704b422b334a8370d3695
Michael K. Cohen
679704b422b334a8370d3696
Micah Carroll
679704b422b334a8370d3697
Orr Paradise
679704b422b334a8370d3698
Jan Hendrik Kirchner
679704b422b334a8370d3699
Stefan Steinerberger
679704b422b334a8370d369a
Maksym Ovchynnikov
679704b422b334a8370d369b
Jason O. Matos
679704b422b334a8370d369c
Adithya Shenoy
679704b422b334a8370d369d
Benedito Alves de Oliveira Junior
679704b422b334a8370d369e
Michael Wang
679704b422b334a8370d369f
Yuzhou Nie
679704b422b334a8370d36a0
Paolo Giordano
679704b422b334a8370d36a1
Philipp Petersen
679704b422b334a8370d36a2
Anna Sztyber-Betley
679704b422b334a8370d36a3
Priti Shukla
679704b422b334a8370d36a4
Jonathan Crozier
679704b422b334a8370d36a5
Antonella Pinto
679704b422b334a8370d36a6
Shreyas Verma
679704b422b334a8370d36a7
Prashant Joshi
679704b422b334a8370d36a8
Zheng-Xin Yong
claimed_verified
2025-05-09T07:23:15.016Z
61424bf4f0d914a5f606a823
https://cdn-avatars.huggingface.co/v1/production/uploads/61424bf4f0d914a5f606a823/0td8lR4elBaVvJUD9Pojh.png
Yong Zheng-Xin
user
yongzx
679704b422b334a8370d36a9
Allison Tee
679704b422b334a8370d36aa
Jérémy Andréoletti
679704b422b334a8370d36ab
Orion Weller
679704b422b334a8370d36ac
Raghav Singhal
679704b422b334a8370d36ad
Gang Zhang
679704b422b334a8370d36ae
Alexander Ivanov
679704b422b334a8370d36af
Seri Khoury
679704b422b334a8370d36b0
Hamid Mostaghimi
679704b422b334a8370d36b1
Kunvar Thaman
679704b422b334a8370d36b2
Qijia Chen
679704b422b334a8370d36b3
Tran Quoc Khánh
679704b422b334a8370d36b4
Jacob Loader
679704b422b334a8370d36b5
Stefano Cavalleri
679704b422b334a8370d36b6
Hannah Szlyk
679704b422b334a8370d36b7
Zachary Brown
679704b422b334a8370d36b8
Jonathan Roberts
679704b422b334a8370d36b9
William Alley
679704b422b334a8370d36ba
Kunyang Sun
679704b422b334a8370d36bb
Ryan Stendall
679704b422b334a8370d36bc
Max Lamparth
679704b422b334a8370d36bd
Anka Reuel
679704b422b334a8370d36be
Ting Wang
679704b422b334a8370d36bf
Hanmeng Xu
679704b422b334a8370d36c0
Sreenivas Goud Raparthi
679704b422b334a8370d36c1
Pablo Hernández-Cámara
679704b422b334a8370d36c2
Freddie Martin
679704b422b334a8370d36c3
Dmitry Malishev
679704b422b334a8370d36c4
Thomas Preu
679704b422b334a8370d36c5
Tomek Korbak
679704b422b334a8370d36c6
Marcus Abramovitch
679704b422b334a8370d36c7
Dominic Williamson
679704b422b334a8370d36c8
Ziye Chen
679704b422b334a8370d36c9
Biró Bálint
679704b422b334a8370d36ca
M Saiful Bari
679704b422b334a8370d36cb
Peyman Kassani
679704b422b334a8370d36cc
Zihao Wang
679704b422b334a8370d36cd
Behzad Ansarinejad
679704b422b334a8370d36ce
Laxman Prasad Goswami
679704b422b334a8370d36cf
Yewen Sun
679704b422b334a8370d36d0
Hossam Elgnainy
679704b422b334a8370d36d1
Daniel Tordera
679704b422b334a8370d36d2
George Balabanian
679704b422b334a8370d36d3
Earth Anderson
679704b422b334a8370d36d4
Lynna Kvistad
679704b422b334a8370d36d5
Alejandro José Moyano
679704b422b334a8370d36d6
Rajat Maheshwari
679704b422b334a8370d36d7
Ahmad Sakor
679704b422b334a8370d36d8
Murat Eron
679704b422b334a8370d36d9
Isaac C. McAlister
679704b422b334a8370d36da
Javier Gimenez
679704b422b334a8370d36db
Innocent Enyekwe
679704b422b334a8370d36dc
Andrew Favre D. O.
679704b422b334a8370d36dd
Shailesh Shah
679704b422b334a8370d36de
Xiaoxiang Zhou
679704b422b334a8370d36df
Firuz Kamalov
679704b422b334a8370d36e0
Ronald Clark
679704b422b334a8370d36e1
Sherwin Abdoli
679704b422b334a8370d36e2
Tim Santens
679704b422b334a8370d36e3
Khalida Meer
679704b422b334a8370d36e4
Harrison K Wang
679704b422b334a8370d36e5
Kalyan Ramakrishnan
679704b422b334a8370d36e6
Evan Chen
679704b422b334a8370d36e7
Alessandro Tomasiello
679704b422b334a8370d36e8
G. Bruno De Luca
679704b422b334a8370d36e9
Shi-Zhuo Looi
679704b422b334a8370d36ea
Vinh-Kha Le
679704b422b334a8370d36eb
Noam Kolt
679704b422b334a8370d36ec
Niels Mündler
679704b422b334a8370d36ed
Avi Semler
679704b422b334a8370d36ee
Emma Rodman
679704b422b334a8370d36ef
Jacob Drori
679704b422b334a8370d36f0
Carl J Fossum
679704b422b334a8370d36f1
Milind Jagota
679704b422b334a8370d36f2
Ronak Pradeep
679704b422b334a8370d36f3
Honglu Fan
679704b422b334a8370d36f4
Tej Shah
679704b422b334a8370d36f5
Jonathan Eicher
679704b422b334a8370d36f6
Michael Chen
679704b422b334a8370d36f7
Kushal Thaman
679704b422b334a8370d36f8
William Merrill
679704b422b334a8370d36f9
Carter Harris
679704b422b334a8370d36fa
Jason Gross
679704b422b334a8370d36fb
Ilya Gusev
679704b422b334a8370d36fc
Asankhaya Sharma
claimed_verified
2025-06-11T08:40:00.071Z
62f32eab52ad88c930bb3f3b
https://cdn-avatars.huggingface.co/v1/production/uploads/1677134945205-62f32eab52ad88c930bb3f3b.png
Asankhaya Sharma
user
codelion
679704b422b334a8370d36fd
Shashank Agnihotri
claimed_verified
2025-04-29T07:59:19.472Z
67162cabea37ca179f5965c9
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/7lKl5w8ecex4eP2I89MPz.png
Shashank Agnihotri
user
shashankskagnihotri
679704b422b334a8370d36fe
Pavel Zhelnov
679704b422b334a8370d36ff
Siranut Usawasutsakorn
679704b422b334a8370d3700
Mohammadreza Mofayezi
679704b422b334a8370d3701
Sergei Bogdanov
679704b422b334a8370d3702
Alexander Piperski
679704b422b334a8370d3703
Marc Carauleanu
679704b422b334a8370d3704
David K. Zhang
679704b422b334a8370d3705
Dylan Ler
679704b422b334a8370d3706
Roman Leventov
679704b422b334a8370d3707
Ignat Soroko
679704b422b334a8370d3708
Thorben Jansen
679704b422b334a8370d3709
Pascal Lauer
679704b422b334a8370d370a
Joshua Duersch
679704b422b334a8370d370b
Vage Taamazyan
679704b422b334a8370d370c
Wiktor Morak
679704b422b334a8370d370d
Wenjie Ma
679704b422b334a8370d370e
William Held
claimed_verified
2025-02-26T08:42:57.161Z
632116accafe12f481a473cb
https://cdn-avatars.huggingface.co/v1/production/uploads/1666207676653-632116accafe12f481a473cb.jpeg
Will Held
user
WillHeld
679704b422b334a8370d370f
Tran Đuc Huy
679704b422b334a8370d3710
Ruicheng Xian
679704b422b334a8370d3711
Armel Randy Zebaze
679704b422b334a8370d3712
Mohanad Mohamed
679704b422b334a8370d3713
Julian Noah Leser
679704b422b334a8370d3714
Michelle X Yuan
679704b422b334a8370d3715
Laila Yacar
679704b422b334a8370d3716
Johannes Lengler
679704b422b334a8370d3717
Hossein Shahrtash
679704b422b334a8370d3718
Edson Oliveira
679704b422b334a8370d3719
Joseph W. Jackson
679704b422b334a8370d371a
Daniel Espinosa Gonzalez
679704b422b334a8370d371b
Andy Zou
679704b422b334a8370d371c
Muthu Chidambaram
679704b422b334a8370d371d
Timothy Manik
679704b422b334a8370d371e
Hector Haffenden
679704b422b334a8370d371f
Dashiell Stander
679704b422b334a8370d3720
Ali Dasouqi
679704b422b334a8370d3721
Alexander Shen
679704b422b334a8370d3722
Emilien Duc
679704b422b334a8370d3723
Bita Golshani
679704b422b334a8370d3724
David Stap
679704b422b334a8370d3725
Mikalai Uzhou
679704b422b334a8370d3726
Alina Borisovna Zhidkovskaya
679704b422b334a8370d3727
Lukas Lewark
679704b422b334a8370d3728
Mátyás Vincze
claimed_verified
2025-02-03T08:16:10.413Z
6454203c548f22be59825ee3
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/kfKhnt59IiCvVoPS8JP3-.jpeg
Mátyás Vincze
user
vinczematyas
679704b422b334a8370d3729
Dustin Wehr
679704b422b334a8370d372a
Colin Tang
679704b422b334a8370d372b
Zaki Hossain
679704b422b334a8370d372c
Shaun Phillips
679704b422b334a8370d372d
Jiang Muzhen
679704b422b334a8370d372e
Fredrik Ekström
679704b422b334a8370d372f
Angela Hammon
679704b422b334a8370d3730
Oam Patel
679704b422b334a8370d3731
Nicolas Remy
679704b422b334a8370d3732
Faraz Farhidi
679704b422b334a8370d3733
George Medley
679704b422b334a8370d3734
Forough Mohammadzadeh
679704b422b334a8370d3735
Madellene Peñaflor
679704b422b334a8370d3736
Haile Kassahun
679704b422b334a8370d3737
Alena Friedrich
679704b422b334a8370d3738
Claire Sparrow
679704b422b334a8370d3739
Taom Sakal
679704b422b334a8370d373a
Omkar Dhamane
679704b422b334a8370d373b
Ali Khajegili Mirabadi
679704b422b334a8370d373c
Eric Hallman
679704b422b334a8370d373d
Mike Battaglia
679704b422b334a8370d373e
Mohammad Maghsoudimehrabani
679704b422b334a8370d373f
Hieu Hoang
679704b422b334a8370d3740
Alon Amit
679704b422b334a8370d3741
Dave Hulbert
679704b422b334a8370d3742
Roberto Pereira
679704b422b334a8370d3743
Simon Weber
679704b422b334a8370d3744
Stephen Mensah
679704b422b334a8370d3745
Nathan Andre
679704b422b334a8370d3746
Anton Peristyy
679704b422b334a8370d3747
Chris Harjadi
679704b422b334a8370d3748
Himanshu Gupta
679704b422b334a8370d3749
Stephen Malina
679704b422b334a8370d374a
Samuel Albanie
679704b422b334a8370d374b
Will Cai
claimed_verified
2025-04-09T16:22:51.134Z
671f7193315a5b40773b36c3
/avatars/e097da0032341958c57237e4006587ab.svg
Will Cai
user
wicai24
679704b422b334a8370d374c
Mustafa Mehkary
679704b422b334a8370d374d
Frank Reidegeld
679704b422b334a8370d374e
Anna-Katharina Dick
679704b422b334a8370d374f
Cary Friday
679704b422b334a8370d3750
Jasdeep Sidhu
679704b422b334a8370d3751
Wanyoung Kim
679704b422b334a8370d3752
Mariana Costa
679704b422b334a8370d3753
Hubeyb Gurdogan
679704b422b334a8370d3754
Brian Weber
679704b422b334a8370d3755
Harsh Kumar
679704b422b334a8370d3756
Tong Jiang
679704b422b334a8370d3757
Arunim Agarwal
679704b422b334a8370d3758
Chiara Ceconello
679704b422b334a8370d3759
Warren S. Vaz
679704b422b334a8370d375a
Chao Zhuang
679704b422b334a8370d375b
Haon Park
679704b422b334a8370d375c
Andrew R. Tawfeek
679704b422b334a8370d375d
Daattavya Aggarwal
679704b422b334a8370d375e
Michael Kirchhof
679704b422b334a8370d375f
Linjie Dai
679704b422b334a8370d3760
Evan Kim
679704b422b334a8370d3761
Johan Ferret
679704b422b334a8370d3762
Yuzhou Wang
679704b422b334a8370d3763
Minghao Yan
679704b422b334a8370d3764
Krzysztof Burdzy
679704b422b334a8370d3765
Lixin Zhang
679704b422b334a8370d3766
Antonio Franca
679704b422b334a8370d3767
Diana T. Pham
679704b422b334a8370d3768
Kang Yong Loh
679704b422b334a8370d3769
Joshua Robinson
679704b422b334a8370d376a
Shreen Gul
679704b422b334a8370d376b
Gunjan Chhablani
679704b422b334a8370d376c
Zhehang Du
679704b422b334a8370d376d
Adrian Cosma
679704b422b334a8370d376e
Colin White
679704b422b334a8370d376f
Robin Riblet
679704b422b334a8370d3770
Prajvi Saxena
679704b422b334a8370d3771
Jacob Votava
679704b422b334a8370d3772
Vladimir Vinnikov
679704b422b334a8370d3773
Ethan Delaney
679704b422b334a8370d3774
Shiv Halasyamani
679704b422b334a8370d3775
Syed M. Shahid
679704b422b334a8370d3776
Jean-Christophe Mourrat
679704b422b334a8370d3777
Lavr Vetoshkin
679704b422b334a8370d3778
Renas Bacho
679704b422b334a8370d3779
Vincent Ginis
679704b422b334a8370d377a
Aleksandr Maksapetyan
679704b422b334a8370d377b
Florencia de la Rosa
679704b422b334a8370d377c
Xiuyu Li
679704b422b334a8370d377d
Guillaume Malod
679704b422b334a8370d377e
Leon Lang
679704b422b334a8370d377f
Julien Laurendeau
679704b422b334a8370d3780
Fatimah Adesanya
679704b422b334a8370d3781
Julien Portier
679704b422b334a8370d3782
Lawrence Hollom
679704b422b334a8370d3783
Victor Souza
679704b422b334a8370d3784
Yuchen Anna Zhou
679704b422b334a8370d3785
Yiğit Yalın
679704b422b334a8370d3786
Gbenga Daniel Obikoya
679704b422b334a8370d3787
Luca Arnaboldi
679704b422b334a8370d3788
Rai
679704b422b334a8370d3789
Filippo Bigi
679704b422b334a8370d378a
Kaniuar Bacho
679704b422b334a8370d378b
Pierre Clavier
679704b422b334a8370d378c
Gabriel Recchia
679704b422b334a8370d378d
Mara Popescu
679704b422b334a8370d378e
Nikita Shulga
679704b422b334a8370d378f
Ngefor Mildred Tanwie
679704b422b334a8370d3790
Thomas C. H. Lux
679704b422b334a8370d3791
Ben Rank
679704b422b334a8370d3792
Colin Ni
679704b422b334a8370d3793
Alesia Yakimchyk
679704b422b334a8370d3794
Huanxu
679704b422b334a8370d3795
Liu
679704b422b334a8370d3796
Olle Häggström
679704b422b334a8370d3797
Emil Verkama
679704b422b334a8370d3798
Himanshu Narayan
679704b422b334a8370d3799
Hans Gundlach
679704b422b334a8370d379a
Leonor Brito-Santana
679704b422b334a8370d379b
Brian Amaro
679704b422b334a8370d379c
Vivek Vajipey
679704b422b334a8370d379d
Rynaa Grover
679704b422b334a8370d379e
Yiyang Fan
679704b422b334a8370d379f
Gabriel Poesia Reis e Silva
679704b422b334a8370d37a0
Linwei Xin
679704b422b334a8370d37a1
Yosi Kratish
679704b422b334a8370d37a2
Jakub Łucki
679704b422b334a8370d37a3
Wen-Ding Li
679704b422b334a8370d37a4
Justin Xu
679704b422b334a8370d37a5
Kevin Joseph Scaria
679704b422b334a8370d37a6
Freddie Vargus
claimed_verified
2025-05-29T07:47:14.228Z
618cb927ec9a3fd349fa7e26
/avatars/75c81a484fcafac3b40ed6ca01832faf.svg
Freddie Vargus
user
freddie
679704b422b334a8370d37a7
Farzad Habibi
679704b422b334a8370d37a8
Long
679704b422b334a8370d37a9
Lian
679704b422b334a8370d37aa
Emanuele Rodolà
679704b422b334a8370d37ab
Jules Robins
679704b422b334a8370d37ac
Vincent Cheng
679704b422b334a8370d37ad
Declan Grabb
679704b422b334a8370d37ae
Ida Bosio
679704b422b334a8370d37af
Tony Fruhauff
679704b422b334a8370d37b0
Ido Akov
679704b422b334a8370d37b1
Eve J. Y. Lo
679704b422b334a8370d37b2
Hao Qi
679704b422b334a8370d37b3
Xi Jiang
679704b422b334a8370d37b4
Ben Segev
679704b422b334a8370d37b5
Jingxuan Fan
679704b422b334a8370d37b6
Sarah Martinson
679704b422b334a8370d37b7
Erik Y. Wang
679704b422b334a8370d37b8
Kaylie Hausknecht
679704b422b334a8370d37b9
Michael P. Brenner
679704b422b334a8370d37ba
Mao Mao
679704b422b334a8370d37bb
Yibo Jiang
679704b422b334a8370d37bc
Xinyu Zhang
679704b422b334a8370d37bd
David Avagian
679704b422b334a8370d37be
Eshawn Jessica Scipio
679704b422b334a8370d37bf
Muhammad Rehan Siddiqi
679704b422b334a8370d37c0
Alon Ragoler
679704b422b334a8370d37c1
Justin Tan
679704b422b334a8370d37c2
Deepakkumar Patil
679704b422b334a8370d37c3
Rebeka Plecnik
679704b422b334a8370d37c4
Aaron Kirtland
679704b422b334a8370d37c5
Roselynn Grace Montecillo
679704b422b334a8370d37c6
Stephane Durand
679704b422b334a8370d37c7
Omer Faruk Bodur
679704b422b334a8370d37c8
Zahra Adoul
679704b422b334a8370d37c9
Mohamed Zekry
679704b422b334a8370d37ca
Guillaume Douville
679704b422b334a8370d37cb
Ali Karakoc
679704b422b334a8370d37cc
Tania C. B. Santos
679704b422b334a8370d37cd
Samir Shamseldeen
679704b422b334a8370d37ce
Loukmane Karim
679704b422b334a8370d37cf
Anna Liakhovitskaia
679704b422b334a8370d37d0
Nate Resman
679704b422b334a8370d37d1
Nicholas Farina
679704b422b334a8370d37d2
Juan Carlos Gonzalez
679704b422b334a8370d37d3
Gabe Maayan
679704b422b334a8370d37d4
Sarah Hoback
679704b422b334a8370d37d5
Rodrigo De Oliveira Pena
679704b422b334a8370d37d6
Glen Sherman
679704b422b334a8370d37d7
Hodjat Mariji
679704b422b334a8370d37d8
Rasoul Pouriamanesh
679704b422b334a8370d37d9
Wentao Wu
679704b422b334a8370d37da
Gözdenur Demir
679704b422b334a8370d37db
Sandra Mendoza
679704b422b334a8370d37dc
Ismail Alarab
679704b422b334a8370d37dd
Joshua Cole
679704b422b334a8370d37de
Danyelle Ferreira
679704b422b334a8370d37df
Bryan Johnson
679704b422b334a8370d37e0
Hsiaoyun Milliron
679704b422b334a8370d37e1
Mohammad Safdari
679704b422b334a8370d37e2
Liangti Dai
679704b422b334a8370d37e3
Siriphan Arthornthurasuk
679704b422b334a8370d37e4
Alexey Pronin
679704b422b334a8370d37e5
Jing Fan
679704b422b334a8370d37e6
Angel Ramirez-Trinidad
679704b422b334a8370d37e7
Ashley Cartwright
679704b422b334a8370d37e8
Daphiny Pottmaier
679704b422b334a8370d37e9
Omid Taheri
679704b422b334a8370d37ea
David Outevsky
679704b422b334a8370d37eb
Stanley Stepanic
679704b422b334a8370d37ec
Samuel Perry
679704b422b334a8370d37ed
Luke Askew
679704b422b334a8370d37ee
Raúl Adrián Huerta Rodríguez
679704b422b334a8370d37ef
Abdelkader Dendane
679704b422b334a8370d37f0
Sam Ali
679704b422b334a8370d37f1
Ricardo Lorena
679704b422b334a8370d37f2
Krishnamurthy Iyer
679704b422b334a8370d37f3
Sk Md Salauddin
679704b422b334a8370d37f4
Murat Islam
679704b422b334a8370d37f5
Juan Gonzalez
679704b422b334a8370d37f6
Josh Ducey
679704b422b334a8370d37f7
Russell Campbell
679704b422b334a8370d37f8
Maja Somrak
679704b422b334a8370d37f9
Vasilios Mavroudis
claimed_verified
2025-02-03T08:16:07.872Z
6394e3bb0663665c5f01f688
https://cdn-avatars.huggingface.co/v1/production/uploads/1670855654319-6394e3bb0663665c5f01f688.jpeg
Vasilios Mavroudis
user
vasilisM
679704b422b334a8370d37fa
Eric Vergo
679704b422b334a8370d37fb
Juehang Qin
679704b422b334a8370d37fc
Benjámin Borbás
679704b422b334a8370d37fd
Eric Chu
679704b422b334a8370d37fe
Jack Lindsey
679704b422b334a8370d37ff
Anil Radhakrishnan
679704b422b334a8370d3800
Antoine Jallon
679704b422b334a8370d3801
I. M. J. McInnis
679704b422b334a8370d3802
Alex Hoover
679704b422b334a8370d3803
Sören Möller
679704b422b334a8370d3804
Song Bian
679704b422b334a8370d3805
John Lai
679704b422b334a8370d3806
Tejal Patwardhan
679704b422b334a8370d3807
Summer Yue
679704b422b334a8370d3808
Alexandr Wang
679704b422b334a8370d3809
Dan Hendrycks
Humanity's Last Exam
Benchmarks are important tools for tracking the rapid advancements in large
language model (LLM) capabilities. However, benchmarks are not keeping pace in
difficulty: LLMs now achieve over 90\% accuracy on popular benchmarks like
MMLU, limiting informed measurement of state-of-the-art LLM capabilities. In
response, we introduce Humanity's Last Exam (HLE), a multi-modal benchmark at
the frontier of human knowledge, designed to be the final closed-ended academic
benchmark of its kind with broad subject coverage. HLE consists of 3,000
questions across dozens of subjects, including mathematics, humanities, and the
natural sciences. HLE is developed globally by subject-matter experts and
consists of multiple-choice and short-answer questions suitable for automated
grading. Each question has a known solution that is unambiguous and easily
verifiable, but cannot be quickly answered via internet retrieval.
State-of-the-art LLMs demonstrate low accuracy and calibration on HLE,
highlighting a significant gap between current LLM capabilities and the expert
human frontier on closed-ended academic questions. To inform research and
policymaking upon a clear understanding of model capabilities, we publicly
release HLE at https://lastexam.ai.
HLE is a challenging multi-modal benchmark that highlights the limitations of current LLMs in closed-ended academic questions.
large language model (LLM) benchmarks MMLU Humanity's Last Exam (HLE) multi-modal benchmark broad subject coverage multiple-choice short-answer questions automated grading accuracy