6 2 2

kyle PRO

kaikaidai

kaikaidai

AI & ML interests

None yet

Recent Activity

updated a Space 7 days ago

AtlaAI/judge-arena

new activity 10 days ago

AtlaAI/judge-arena:Promotion to get more voters

posted an update 21 days ago

📈 Early results on the 8B evaluation model we've been training... @NinaCalvi wrote about the progress we've made this quarter towards training the best 'LLM-as-a-judge' evaluator. We've significantly improved against the baseline and are approaching state-of-the-art evaluation performance with an 8B model. Next up: training Llama-3.1-70B 👀 Here's the full article: https://www.atla-ai.com/post/evaluating-the-evaluator

View all activity

Articles

Judge Arena: Benchmarking LLMs as Evaluators

Nov 19

• 53

Experimenting with different training objectives for an AI evaluator

Oct 31

• 2

Organizations

kaikaidai's activity

updated a Space 7 days ago

Running

💻

Judge Arena

New activity in AtlaAI/judge-arena 10 days ago

Promotion to get more voters

#7 opened 11 days ago by

softclone

posted an update 21 days ago

Post

1025

📈 Early results on the 8B evaluation model we've been training...

@NinaCalvi wrote about the progress we've made this quarter towards training the best 'LLM-as-a-judge' evaluator. We've significantly improved against the baseline and are approaching state-of-the-art evaluation performance with an 8B model.

Next up: training Llama-3.1-70B 👀

Here's the full article: https://www.atla-ai.com/post/evaluating-the-evaluator