kyle's picture

6 2 2

kyle PRO

kaikaidai

·

kaikaidai

AI & ML interests

None yet

Recent Activity

updated a Space 7 days ago

AtlaAI/judge-arena

new activity 10 days ago

AtlaAI/judge-arena:Promotion to get more voters

posted an update 21 days ago

📈 Early results on the 8B evaluation model we've been training... @NinaCalvi wrote about the progress we've made this quarter towards training the best 'LLM-as-a-judge' evaluator. We've significantly improved against the baseline and are approaching state-of-the-art evaluation performance with an 8B model. Next up: training Llama-3.1-70B 👀 Here's the full article: https://www.atla-ai.com/post/evaluating-the-evaluator

View all activity

Articles

Judge Arena: Benchmarking LLMs as Evaluators

Experimenting with different training objectives for an AI evaluator

Organizations

kaikaidai's activity

New activity in AtlaAI/judge-arena 10 days ago

Promotion to get more voters

#7 opened 11 days ago by

New activity in AtlaAI/judge-arena 23 days ago

About adding a judge model to the leaderboard

#6 opened 23 days ago by

New activity in AtlaAI/judge-arena 28 days ago

Which models do you want to see on here?

#2 opened about 1 month ago by

New activity in AtlaAI/judge-arena 29 days ago

Apply for community grant: Company project (gpu and storage)

#5 opened 29 days ago by

New activity in AtlaAI/judge-arena about 1 month ago

What are Meta-Llama-3.1-Instruct "Turbo" models?

#4 opened about 1 month ago by

Push main

#1 opened about 1 month ago by

Push main

#1 opened about 1 month ago by