Arabic MMLU

#9
by Malikeh1375 - opened

Hi,
There are two versions of MMLU: one is the Arabic MMLU one generated by arabic speakers (https://huggingface.co/datasets/OALL/Arabic_MMLU) and the other one is the translated version of MMLU (https://huggingface.co/datasets/OALL/AlGhafa-Arabic-LLM-Benchmark-Translated). I wonder which one is used for the evaluation part of OALL.

Best,
Malikeh

Sign up or log in to comment