Judge Arena: Benchmarking LLMs as Evaluators
•
53
kyle PRO
kaikaidai
AI & ML interests
None yet
Recent Activity
updated
a Space
7 days ago
AtlaAI/judge-arena
new activity
10 days ago
AtlaAI/judge-arena:Promotion to get more voters
posted
an
update
22 days ago
📈 Early results on the 8B evaluation model we've been training...
@NinaCalvi wrote about the progress we've made this quarter towards training the best 'LLM-as-a-judge' evaluator. We've significantly improved against the baseline and are approaching state-of-the-art evaluation performance with an 8B model.
Next up: training Llama-3.1-70B 👀
Here's the full article: https://www.atla-ai.com/post/evaluating-the-evaluator
Articles
Organizations
kaikaidai's activity
liked
a
Space
about 1 month ago
liked
a
Space
about 2 months ago