content.raw: Besides being the coolest named benchmark in the game, HellaSwag is an important measurement of здравый смысль (or common sense) in LLMs.
content.type: text
content.value: Besides being the coolest named benchmark in the game, HellaSwag is an important measurement of здравый смысль (or common sense) in LLMs.
content.type: new_line
content.type: new_line
content.raw: - More on HellaSwag: 
content.type: text
content.value: - More on HellaSwag: 
content.href: https://github.com/rowanz/hellaswag
content.raw: https://github.com/rowanz/hellaswag
content.type: link
content.type: new_line
content.type: new_line
content.raw: I spent the afternoon benchmarking YandexGPT Pro 4th Gen, one of the Russian tech giant's premier models.
content.type: text
content.value: I spent the afternoon benchmarking YandexGPT Pro 4th Gen, one of the Russian tech giant's premier models.
content.type: new_line
content.type: new_line
content.raw: - Yandex HF Org: 
content.type: text
content.value: - Yandex HF Org: 
content.image: https://cdn-avatars.huggingface.co/v1/production/uploads/1655918403280-609baae0fe087f3d04cf0481.jpeg
content.raw: https://huggingface.co/yandex
content.id: yandex
content.type: org
content.type: resource
content.url: https://huggingface.co/yandex
content.type: new_line
content.raw: - More on Yandex models: 
content.type: text
content.value: - More on Yandex models: 
content.href: https://yandex.cloud/ru/docs/foundation-models/concepts/yandexgpt/models
content.raw: https://yandex.cloud/ru/docs/foundation-models/concepts/yandexgpt/models
content.type: link
content.type: new_line
content.type: new_line
content.raw: The eval notebook is available on GitHub and the resulting dataset is already on the HF Hub!
content.type: text
content.value: The eval notebook is available on GitHub and the resulting dataset is already on the HF Hub!
content.type: new_line
content.type: new_line
content.raw: - Eval Notebook: 
content.type: text
content.value: - Eval Notebook: 
content.href: https://github.com/kghamilton89/ai-explorer/blob/main/yandex-hellaswag/hellaswag-assess.ipynb
content.raw: https://github.com/kghamilton89/ai-explorer/blob/main/yandex-hellaswag/hellaswag-assess.ipynb
content.type: link
content.type: new_line
content.raw: - Eval Dataset: 
content.type: text
content.value: - Eval Dataset: 
content.raw: https://huggingface.co/datasets/ZennyKenny/yandexgptpro_4th_gen-hellaswag
content.id: ZennyKenny/yandexgptpro_4th_gen-hellaswag
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/ZennyKenny/yandexgptpro_4th_gen-hellaswag
content.type: new_line
content.type: new_line
content.raw: And of course, everyone wants to see the results so have a look at the results in the context of other zero-shot experiments that I was able to find!
content.type: text
content.value: And of course, everyone wants to see the results so have a look at the results in the context of other zero-shot experiments that I was able to find!
rawContent: Besides being the coolest named benchmark in the game, HellaSwag is an important measurement of здравый смысль (or common sense) in LLMs.
  
  - More on HellaSwag: https://github.com/rowanz/hellaswag
  
  I spent the afternoon benchmarking YandexGPT Pro 4th Gen, one of the Russian tech giant's premier models.
  
  - Yandex HF Org: https://huggingface.co/yandex
  - More on Yandex models: https://yandex.cloud/ru/docs/foundation-models/concepts/yandexgpt/models
  
  The eval notebook is available on GitHub and the resulting dataset is already on the HF Hub!
  
  - Eval Notebook: https://github.com/kghamilton89/ai-explorer/blob/main/yandex-hellaswag/hellaswag-assess.ipynb
  - Eval Dataset: https://huggingface.co/datasets/ZennyKenny/yandexgptpro_4th_gen-hellaswag
  
  And of course, everyone wants to see the results so have a look at the results in the context of other zero-shot experiments that I was able to find!
reactions.reaction: ❤️
reactions.users: PujiPramusanto modenn Nggajr xanzzzz kuma21 xinnn63 John6666 limaku willdinata risxyie Takugen dantezxcd on3dj
reactions.reaction: 🔥
reactions.users: loqhunter Abru dantezxcd
reactions.reaction: ➕
reactions.users: 31d332y0v3rj0y3d dantezxcd
commentators._id: 6758a9850e3fff481964ca6d
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/EolfJfjW25hC4Bt_hCPq8.png
commentators.fullname: Jean Louis
commentators.name: JLouisBiz
commentators.type: user
commentators._id: 656e3808d4de03a07d116850
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/656e3808d4de03a07d116850/62cFw46AmuhdI3gS24F1M.jpeg
commentators.fullname: Kenneth Hamilton
commentators.name: ZennyKenny
commentators.type: user