content.raw: We 
content.type: text
content.value: We 
content.href: https://mii-llm.ai
content.raw: https://mii-llm.ai
content.type: link
content.raw:  just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA
content.type: text
content.value:  just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA
content.type: new_line
content.type: new_line
content.raw: Thanks to 
content.type: text
content.value: Thanks to 
content.raw: @efederici
content.type: mention
content.user: efederici
content.raw:  who released 
content.type: text
content.value:  who released 
content.raw: https://huggingface.co/datasets/efederici/MMLU-Pro-ita
content.id: efederici/MMLU-Pro-ita
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/efederici/MMLU-Pro-ita
content.raw:  a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of 
content.type: text
content.value:  a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of 
content.href: https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
content.raw: https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
content.type: link
content.raw:  the results on Italian open source LLMs. 
content.type: text
content.value:  the results on Italian open source LLMs. 
content.type: new_line
content.type: new_line
content.raw: If you want to deepen read the blog article on hf 
content.type: text
content.value: If you want to deepen read the blog article on hf 
content.href: https://huggingface.co/blog/giux78/mmlu-pro-ita
content.raw: https://huggingface.co/blog/giux78/mmlu-pro-ita
content.type: link
content.type: text
rawContent: We https://mii-llm.ai just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA
  
  Thanks to @efederici who released https://huggingface.co/datasets/efederici/MMLU-Pro-ita a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard the results on Italian open source LLMs. 
  
  If you want to deepen read the blog article on hf https://huggingface.co/blog/giux78/mmlu-pro-ita 
reactions.reaction: 🚀
reactions.users: giux78 Ramikan-BR osanseviero
reactions.reaction: ❤️
reactions.users: Ramikan-BR anakin87
reactions.reaction: 🔥
reactions.users: Ramikan-BR
reactions.reaction: 👀
reactions.users: Ramikan-BR
reactions.reaction: 😔
reactions.users: ZeroWw