Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Arabic MMLU
#9
by
Malikeh1375
- opened
Hi,
There are two versions of MMLU: one is the Arabic MMLU one generated by arabic speakers (https://huggingface.co/datasets/OALL/Arabic_MMLU) and the other one is the translated version of MMLU (https://huggingface.co/datasets/OALL/AlGhafa-Arabic-LLM-Benchmark-Translated). I wonder which one is used for the evaluation part of OALL.
Best,
Malikeh