🔥 New LLM leaderboard on the hub: an Enterprise Scenarios Leaderboard!
text
🔥 New LLM leaderboard on the hub: an Enterprise Scenarios Leaderboard!
new_line
new_line
This work evaluates LLMs on several real world use cases (Finance documents, Legal confidentiality, Customer support, ...), which makes it grounded, and interesting  for companies! 🏢
text
This work evaluates LLMs on several real world use cases (Finance documents, Legal confidentiality, Customer support, ...), which makes it grounded, and interesting  for companies! 🏢
new_line
Bonus: the test set is private, so it's hard to game 🔥
text
Bonus: the test set is private, so it's hard to game 🔥
new_line
https://huggingface.co/spaces/PatronusAI/enterprise_scenarios_leaderboard
PatronusAI/enterprise_scenarios_leaderboard
space
resource
https://huggingface.co/spaces/PatronusAI/enterprise_scenarios_leaderboard
new_line
new_line
Side note: I discovered through this benchmark that you could evaluate "Engagingness" of an LLM, which could also be interesting for our LLM fine-tuning community out there.
text
Side note: I discovered through this benchmark that you could evaluate "Engagingness" of an LLM, which could also be interesting for our LLM fine-tuning community out there.
new_line
new_line
Read more about their different tasks and metrics in the intro blog: 
text
Read more about their different tasks and metrics in the intro blog: 
https://huggingface.co/blog/leaderboards-on-the-hub-patronus
https://huggingface.co/blog/leaderboards-on-the-hub-patronus
link
new_line
new_line
Congrats to 
text
Congrats to 
@sunitha98
mention
sunitha98
 who led the leaderboard implementation, and to 
text
 who led the leaderboard implementation, and to 
@rebeccaqian
mention
rebeccaqian
 and 
text
 and 
@anandnk24
mention
anandnk24
, all at Patronus AI !
text
, all at Patronus AI !
🔥 New LLM leaderboard on the hub: an Enterprise Scenarios Leaderboard!

This work evaluates LLMs on several real world use cases (Finance documents, Legal confidentiality, Customer support, ...), which makes it grounded, and interesting  for companies! 🏢
Bonus: the test set is private, so it's hard to game 🔥
https://huggingface.co/spaces/PatronusAI/enterprise_scenarios_leaderboard

Side note: I discovered through this benchmark that you could evaluate "Engagingness" of an LLM, which could also be interesting for our LLM fine-tuning community out there.

Read more about their different tasks and metrics in the intro blog: https://huggingface.co/blog/leaderboards-on-the-hub-patronus

Congrats to @sunitha98 who led the leaderboard implementation, and to @rebeccaqian and @anandnk24, all at Patronus AI !
❤️
osanseviero RebeccaQian1 clem marcsun13 samusenps Pelmeshek alielfilali01 anandnk24 gblazex
5e67bdd61009063689407479
https://cdn-avatars.huggingface.co/v1/production/uploads/1583857146757-5e67bdd61009063689407479.jpeg
Clem 🤗
clem
user
6202a599216215a22221dea9
https://cdn-avatars.huggingface.co/v1/production/uploads/1644340617257-noauth.png
Clémentine Fourrier
clefourrier
user