Update leaderboard so can support newer models?

#4
by CombinHorizon - opened

Any plans to update the leaderboard, so that it can support newer derivative models types such as mixtral (8x7B & 8x22B), gemma, & phi-3 ?

thx!

Vectara org

Hey @CombinHorizon
the leaderboard currently lists Mixtral 8x7B, gemma and Phi-3
Are you not seeing those on the leaderboard?

these are then error messages i get, but i'm sorry if they aren't very helpful (the last one is misleading, a newer version of transformers, adds support for phi-3 thus does not require remote-code mode)

Screenshot_%Y.%M.%D_%H-%m-%S-216.png
Screenshot_%Y.%M.%D_%H-%m-%S-217.png
Screenshot_%Y.%M.%D_%H-%m-%S-218.png

(it's differently from manually adding entries, ... wait, it looks like this leaderboard is made of entries that externally added, instead of being organically processed (viewer submitted) and inserted ?!)

Sign up or log in to comment