Spaces:
Running
on
CPU Upgrade
Increasing upper limit of `Select the number of parameters (B)` to support larger open-source models like `meta-llama/Meta-Llama-3.1-405B-Instruct`
Simple change to increase the slider upper limit to include new larger open-source LLMs
Following new commits that happened in this PR, the ephemeral Space open-llm-leaderboard/open_llm_leaderboard-ci-pr-858 has been updated.
(This is an automated message.)
Following new commits that happened in this PR, the ephemeral Space open-llm-leaderboard/open_llm_leaderboard-ci-pr-858 has been updated.
(This is an automated message.)
Following the creation of this PR, an ephemeral Space open-llm-leaderboard/open_llm_leaderboard-ci-pr-858 has been started. Any changes pushed to this PR will be synced with the test Space.
Since this PR has not been created by a trusted author, the ephemeral Space has not been configured with the correct hardware, storage, and secrets. An admin must configure it manually.
(This is an automated message.)
Thank you @singhsidhukuldeep for your PR! This is a good idea, but first let me check if the slider works properly with this change
I checked, the maximum size depends on the maximum size available in the models being evaluated, I'll be able to merge your PR once LLama-405B is on the Leaderboard, as that way I can properly test the slider change
Why is Llama-3.1-405B not on the leaderboard yet?
Hi @SmartManoj ,
The reason is that >150B models require a multi-node set up. For now, our approach is not stable and doesn't work properly, but we will solve it in the near future to add big models