🏅 New top model on the GAIA benchmark!
text
🏅 New top model on the GAIA benchmark!
new_line
new_line
Called FRIDAY, it's a mysterious new autonomous agent, which got quite good performances on both the public validation set *and* the private test set. 
text
Called FRIDAY, it's a mysterious new autonomous agent, which got quite good performances on both the public validation set *and* the private test set. 
new_line
It notably passed 10 points for the val and 5 points for the test set on our hardest questions (level 3): they require to take arbitrarily long sequences of actions, use any number of tools, and access the world in genera! ✨
text
It notably passed 10 points for the val and 5 points for the test set on our hardest questions (level 3): they require to take arbitrarily long sequences of actions, use any number of tools, and access the world in genera! ✨
new_line
new_line
The GAIA benchmark evaluates next-generation LLMs (LLMs with augmented capabilities due to added tooling, efficient prompting, access to search, etc) and was co authored by 
text
The GAIA benchmark evaluates next-generation LLMs (LLMs with augmented capabilities due to added tooling, efficient prompting, access to search, etc) and was co authored by 
@gregmialz
mention
gregmialz
text
@ThomasNLG
mention
ThomasNLG
text
@ylecun
mention
ylecun
text
@thomwolf
mention
thomwolf
 and myself: 
text
 and myself: 
https://huggingface.co/spaces/gaia-benchmark/leaderboard
gaia-benchmark/leaderboard
space
resource
https://huggingface.co/spaces/gaia-benchmark/leaderboard
🏅 New top model on the GAIA benchmark!

Called FRIDAY, it's a mysterious new autonomous agent, which got quite good performances on both the public validation set *and* the private test set. 
It notably passed 10 points for the val and 5 points for the test set on our hardest questions (level 3): they require to take arbitrarily long sequences of actions, use any number of tools, and access the world in genera! ✨

The GAIA benchmark evaluates next-generation LLMs (LLMs with augmented capabilities due to added tooling, efficient prompting, access to search, etc) and was co authored by @gregmialz @ThomasNLG @ylecun @thomwolf and myself: https://huggingface.co/spaces/gaia-benchmark/leaderboard
🤗
gregmialz osanseviero Tonic m-ric clem julien-c kahris
🤯
osanseviero Tonic sharad mariagrandury clem diwank m-ric
5dd96eb166059660ed1ee413
https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/NQtzmrDdbG0H8qkZvRyGk.jpeg
Julien Chaumond
julien-c
user
6202a599216215a22221dea9
https://cdn-avatars.huggingface.co/v1/production/uploads/1644340617257-noauth.png
Clémentine Fourrier
clefourrier
user
65b0e63799d765b8540ebb7f
/avatars/1a24be0db4b9dd60450a3c11e500160f.svg
cihan kızılban
cihan30
user
644cf21fd1945fe77a13df6a
https://cdn-avatars.huggingface.co/v1/production/uploads/644cf21fd1945fe77a13df6a/7rxLPqRgHi6POSs0DR3A0.png
Christian Weyer
christianweyer
user