content.raw: Llama 3.1 405B Instruct beats GPT-4o on MixEval-Hard
content.type: text
content.value: Llama 3.1 405B Instruct beats GPT-4o on MixEval-Hard
content.type: new_line
content.type: new_line
content.raw: Just ran MixEval for 405B, Sonnet-3.5 and 4o, with 405B landing right between the other two at 66.19
content.type: text
content.value: Just ran MixEval for 405B, Sonnet-3.5 and 4o, with 405B landing right between the other two at 66.19
content.type: new_line
content.type: new_line
content.raw: The GPT-4o result of 64.7 replicated locally but Sonnet-3.5 actually scored 70.25/69.45 in my replications 🤔 Still well ahead of the other 2 though.
content.type: text
content.value: The GPT-4o result of 64.7 replicated locally but Sonnet-3.5 actually scored 70.25/69.45 in my replications 🤔 Still well ahead of the other 2 though.
content.type: new_line
content.type: new_line
content.raw: Sammple of 1 of the eval calls here: 
content.type: text
content.value: Sammple of 1 of the eval calls here: 
content.href: https://wandb.ai/morgan/MixEval/weave/calls/07b05ae2-2ef5-4525-98a6-c59963b76fe1
content.raw: https://wandb.ai/morgan/MixEval/weave/calls/07b05ae2-2ef5-4525-98a6-c59963b76fe1
content.type: link
content.type: new_line
content.type: new_line
content.raw: Quick auto-logging tracing for openai-compatible clients and many more here: 
content.type: text
content.value: Quick auto-logging tracing for openai-compatible clients and many more here: 
content.href: https://wandb.github.io/weave/quickstart/
content.raw: https://wandb.github.io/weave/quickstart/
content.type: link
content.type: new_line
content.type: new_line
rawContent: Llama 3.1 405B Instruct beats GPT-4o on MixEval-Hard
  
  Just ran MixEval for 405B, Sonnet-3.5 and 4o, with 405B landing right between the other two at 66.19
  
  The GPT-4o result of 64.7 replicated locally but Sonnet-3.5 actually scored 70.25/69.45 in my replications 🤔 Still well ahead of the other 2 though.
  
  Sammple of 1 of the eval calls here: https://wandb.ai/morgan/MixEval/weave/calls/07b05ae2-2ef5-4525-98a6-c59963b76fe1
  
  Quick auto-logging tracing for openai-compatible clients and many more here: https://wandb.github.io/weave/quickstart/
  
  
reactions.reaction: 👍
reactions.users: zenosai macsz Corvius
reactions.reaction: 🔥
reactions.users: Rohitkhatri75436