Max VRAM usage per model

#67
by Subcode - opened

It might be a nice idea to also list the max VRAM used during evaluation. This could give a good idea of what can and cant be used on certain hardware.

Totally agree!
And add the response times!

Open LLM Leaderboard org

Hi, did you check the performance benchmark?

Hi, did you check the performance benchmark?

That benchmark didnt exist when this post was made. But yes.

Open LLM Leaderboard org
edited Jul 20, 2023

@Subcode Yes, that's why I pointed you towards it - we found that it was better to separate leaderboards from a ux point of view :)

Does it answer what you needed?

clefourrier changed discussion status to closed

Sign up or log in to comment