Leaderboard restarting

#645
by DenisTheDev - opened

Since yesterday, there are the same 8 models at running evaluation and almost 70 in pending. The leaderboard seem to restart once 15 minutes or so. Why is that?

Open LLM Leaderboard org

Hi!
The front end of the leaderboard should restart once every hour or so, I'll clear the cache to see if it changes anything.
Regarding the evaluations, it means that the research cluster is full and no new nodes are free.

DenisTheDev changed discussion status to closed

Sign up or log in to comment