Non applicable

#3 opened 2 months ago by

New activity in paloalma/ECE-TW3-JRGL-V2 2 days ago

Update README.md

#1 opened 2 days ago by

New activity in paloalma/ECE-TW3-JRGL-V4 2 days ago

Update README.md

#1 opened 2 days ago by

New activity in paloalma/ECE-TW3-JRGL-V3 2 days ago

Update README.md

#1 opened 2 days ago by

New activity in VAGOsolutions/Llama-3-SauerkrautLM-70b-Instruct 3 days ago

Update README.md

#3 opened 3 days ago by

New activity in monsterapi/Llama-3_1-8B-Instruct-orca-ORPO 4 days ago

Update README.md

#1 opened 4 days ago by

New activity in Undi95/MG-FinalMix-72B 4 days ago

Update README.md

#3 opened 4 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 4 days ago

Feature Request: add error details summary to request file when a model fails

#935 opened 4 days ago by

Unable to submit model, due to "Unknown model size" (vilm/Quyen-Pro-Max-v0.1)

#934 opened 4 days ago by

New activity in mmnga/Llama-3-70B-japanese-suzume-vector-v0.1 5 days ago

Update README.md

#2 opened 5 days ago by

New activity in saltlux/luxia-21.4b-alignment-v1.0 5 days ago

Update config.json

#12 opened 5 days ago by

New activity in EpistemeAI/Fireball-3.1-8B-ORPO 6 days ago

Update config.json

#1 opened 6 days ago by

New activity in eduagarcia/open_pt_llm_leaderboard 7 days ago

Repeated consecutive run failures of unrelated models on same day - (Error 28: no space left on device)

#12 opened 7 days ago by

New activity in CombinHorizon/YiSM-blossom5.1-34B-SLERP 7 days ago

Adding Evaluation Results

#1 opened 17 days ago by

leaderboard-pr-bot

New activity in davidkim205/Rhea-72b-v0.5 7 days ago

odd results for the updated leaderboard

#10 opened 7 days ago by

New activity in BAAI/open_cn_llm_leaderboard 8 days ago

Repeated failures of various running models

#6 opened about 1 month ago by

New activity in BAAI/open_cn_llm_leaderboard 21 days ago

What is the current status for the leaderboard? (H-CLCC, and any recent results?)

#7 opened 22 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 22 days ago

Failed model (anthracite-org/magnum-v2.5-12b-kto)

#905 opened 22 days ago by

New activity in haoranxu/Llama-3-Instruct-8B-CPO 24 days ago

Update README.md

#4 opened 24 days ago by

New activity in haoranxu/Llama-3-Instruct-8B-CPO about 1 month ago

alma updates ?

#1 opened 3 months ago by

cmp-nct

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

Surprisingly low score of Rhea-72b-v0.5 and TW3-JRGL-v2

#875 opened about 1 month ago by

dnhkng/RYS-XLarge has successfully finished, but is shown in requests log as failed and pending

#874 opened about 1 month ago by

New activity in haoranxu/Llama-3-Instruct-8B-CPO about 2 months ago

Update README.md

#3 opened about 2 months ago by

New activity in haoranxu/Llama-3-Instruct-8B-CPO-SimPO about 2 months ago

Update README.md

#2 opened about 2 months ago by

New activity in OALL/Open-Arabic-LLM-Leaderboard about 2 months ago

Cancel running float32 model (kevinpro/Hydra-LLaMA3-8B-0513-preview)

3

#6 opened 2 months ago by

New activity in upstage/open-ko-llm-leaderboard about 2 months ago

Correction to model-type of BAAI/Infinity-Instruct-3M-0625-Qwen2-7B

#80 opened 2 months ago by

New activity in open-ko-llm-leaderboard/requests about 2 months ago

Update BAAI/Infinity-Instruct-3M-0625-Qwen2-7B_eval_request_False_float16_Original.json

#7 opened about 2 months ago by

New activity in BAAI/open_cn_llm_leaderboard about 2 months ago

What about results/request datasets for the BAAI/open_cn_llm_leaderboard ?, will they be made available?

#4 opened 2 months ago by

Update requirements.txt

#5 opened about 2 months ago by

New activity in upstage/open-ko-llm-leaderboard about 2 months ago

Update requirements.txt

5

#82 opened about 2 months ago by

New activity in BAAI/open_cn_llm_leaderboard about 2 months ago

Update the transformers to v4.41.1(Support the Phi-3 models)

#2 opened 4 months ago by

MerlinLi

New activity in haoranxu/Llama-3-Instruct-8B-CPO about 2 months ago

Update README.md

#2 opened about 2 months ago by

New activity in OALL/Open-Arabic-LLM-Leaderboard about 2 months ago

Some ‘finished’ models aren't visible in the leaderboard (result file is missing)

#5 opened 2 months ago by

New activity in openlifescienceai/open_medical_llm_leaderboard about 2 months ago

Model evaluation and submission stuck of LB.

10

#17 opened 4 months ago by

abideen

Error while opening leaderboard

#11 opened 4 months ago by

skfrost19

New activity in openlifescienceai/requests about 2 months ago

Delete 01-ai/Yi-1.5-9B-Chat_eval_request_False_float32_Original.json

#7 opened about 2 months ago by

Delete 01-ai/Yi-1.5-9B-Chat-16K_eval_request_False_float32_Original.json

#6 opened about 2 months ago by

New activity in OALL/requests about 2 months ago

Question: Whether to cancel this evaluation ... (float32 kevinpro/Hydra-LLaMA3-8B-0513-preview)

3

#13 opened 2 months ago by

Delete kevinpro/Hydra-LLaMA3-8B-0513-preview_eval_request_False_float32_Original.json

#14 opened 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

dolphin-2.9.2-qwen2-72b failed, check logs

#824 opened 3 months ago by

New activity in openlifescienceai/requests 2 months ago

Delete wenbopan/Faro-Yi-9B_eval_request_False_float32_Original.json

#5 opened 2 months ago by

Delete wenbopan/Faro-Yi-9B-DPO_eval_request_False_float32_Original.json

#4 opened 2 months ago by

Delete vicgalle/Configurable-Yi-1.5-9B-Chat_eval_request_False_float32_Original.json

#3 opened 2 months ago by

Delete cognitivecomputations/dolphin-2.9.1-yi-1.5-9b_eval_request_False_float32_Original.json

#2 opened 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

Feature request: Progress meter/indicator (for currently running models)

#832 opened 2 months ago by

New activity in eduagarcia-temp/llm_pt_leaderboard_requests 3 months ago

Delete paloalma/ECE-TW3-JRGL-V1_eval_request_f1916d0_False_float16_Original.json

#2 opened 3 months ago by

New activity in OALL/requests 3 months ago

Update cloudyu/Yi-34Bx2-MoE-60B-DPO_eval_request_False_bfloat16_Original.json

#12 opened 3 months ago by

New activity in open-llm-leaderboard/requests 3 months ago

Update migtissera/Tess-v2.5.2-Qwen2-72B_eval_request_False_float16_Original.json

#16 opened 3 months ago by

New activity in eduagarcia/open_pt_llm_leaderboard 3 months ago

Duplicate run succeeded, the current one may be cancelled

#10 opened 3 months ago by

New activity in hebrew-llm-leaderboard/leaderboard 3 months ago

Update Model Categorization System ?

#2 opened 3 months ago by

New activity in mii-llm/open_ita_llm_leaderboard 3 months ago

Update model types

#14 opened 3 months ago by

New activity in PatronusAI/enterprise_scenarios_leaderboard 3 months ago

problem submitting models to the leaderboard

#12 opened 3 months ago by

New activity in hallucinations-leaderboard/leaderboard 3 months ago

Certain models perhaps clogging up the leaderboard?, Check logs?

#25 opened 4 months ago by

New activity in jhadams/WizardLM_WizardCoder-Python-34B-V1.0_safetensors 3 months ago

Update README.md

#1 opened 3 months ago by

New activity in cognitivecomputations/dolphin-2.6-mixtral-8x7b 3 months ago

Adding `safetensors` variant of this model

#7 opened 6 months ago by

SFconvertbot

New activity in cognitivecomputations/dolphin-2.7-mixtral-8x7b 3 months ago

Adding `safetensors` variant of this model

#5 opened 6 months ago by

SFconvertbot

New activity in GritLM/GritLM-7B-KTO 3 months ago

Create README.md

#1 opened 3 months ago by

New activity in Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.4 3 months ago

add license, so can be added to leaderboard benchmark?

#1 opened 3 months ago by

New activity in vectara/leaderboard 4 months ago

Update leaderboard so can support newer models?

#4 opened 4 months ago by

New activity in openlifescienceai/open_medical_llm_leaderboard 4 months ago

Update leaderboard so can support newer models?

#14 opened 4 months ago by