Update leaderboard so can support newer models? (Can't submit newer Qwen2+, gemma, phi models)

#3
by CombinHorizon - opened

Any plans to update the leaderboard, so that it can support (detect) newer derivative models types such as qwen2, gemma2, & gemma, phi ?

the error message is Model {model name}was not found on the hub!

thx!

examples:
MaziyarPanahi/Qwen2-72B-Instruct-v0.1
pankajmathur/orca_mini_v7_72b
migtissera/Tess-v2.5.2-Qwen2-72B
dfurman/Qwen2-72B-Orpo-v0.1
cognitivecomputations/dolphin-2.9.2-qwen2-72b
cognitivecomputations/dolphin-2.9.2-qwen2-7b
Alibaba-NLP/gte-Qwen2-7B-instruct
Weyaxi/Einstein-v7-Qwen2-7B
BAAI/Infinity-Instruct-3M-0625-Qwen2-7B
macadeliccc/Samantha-Qwen-2-7B

openchat/openchat-3.5-0106-gemma
beomi/gemma-mling-7b
SakanaAI/DiscoPOP-zephyr-7b-gemma

TheDrummer/Big-Tiger-Gemma-27B-v1
TheDrummer/Tiger-Gemma-9B-v1

the error message is Model "{model name}" was not found on hub!

see: https://huggingface.co/spaces/BAAI/open_cn_llm_leaderboard/blob/main/src/submission/check_validity.py#L63

here are some leaderboards that somehow supported those models , what could be updated, what is missing or out-of-date?

https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
Open-Arabic-LLM-Leaderboard
open_pt_llm_leaderboard
open-ko-llm-leaderboard

CombinHorizon changed discussion title from Update leaderboard so can support newer models? to Update leaderboard so can support newer models? (Can't submit newer Qwen2+, gemma, phi models)

Sign up or log in to comment