Spaces:

---

open-llm-leaderboard

/

open_llm_leaderboard

like 13.4k

Running on CPU Upgrade

Same observation. Just to add to @Kiddyz , several models added to the queue for evaluation are stuck under PENDING while newer submissions seem to get processed before these models that have been in the queue for days. Can you please advise, @clefourrier ? Thanks.

Please provide some support, thank you very much! @thomwolf

Hi @Kiddyz !
Thank you for your interest in the leaderboard.
A number of models appeared as failed in the queue over the weekend, because we had a connectivity problem and their results were not uploaded to the dataset. This has been fixed now.

@clefourrier hi, leader board is down again.

@Kiddyz Hi, the leaderboard seems to be running, what's not working for you?

@clefourrier all the tasks in the evaluation queue are currently hang.

The evaluation queue has slowed down because we are running bigger experiments on our cluster at the moment. Thank you for your patience.

Since this is not a bug, I'm closing the issue.