content.raw: We outperform Llama 70B with Llama 3B on hard math by scaling test-time compute 🔥
content.type: text
content.value: We outperform Llama 70B with Llama 3B on hard math by scaling test-time compute 🔥
content.type: new_line
content.type: new_line
content.raw: How? By combining step-wise reward models with tree search algorithms :)
content.type: text
content.value: How? By combining step-wise reward models with tree search algorithms :)
content.type: new_line
content.type: new_line
content.raw: We show that smol models can match or exceed the performance of their much larger siblings when given enough "time to think"
content.type: text
content.value: We show that smol models can match or exceed the performance of their much larger siblings when given enough "time to think"
content.type: new_line
content.type: new_line
content.raw: We're open sourcing the full recipe and sharing a detailed blog post.
content.type: text
content.value: We're open sourcing the full recipe and sharing a detailed blog post.
content.type: new_line
content.type: new_line
content.raw: In our blog post we cover:
content.type: text
content.value: In our blog post we cover:
content.type: new_line
content.type: new_line
content.raw: 📈 Compute-optimal scaling: How we implemented DeepMind's recipe to boost the mathematical capabilities of open models at test-time.
content.type: text
content.value: 📈 Compute-optimal scaling: How we implemented DeepMind's recipe to boost the mathematical capabilities of open models at test-time.
content.type: new_line
content.type: new_line
content.raw: 🎄 Diverse Verifier Tree Search (DVTS): An unpublished extension we developed to the verifier-guided tree search technique. This simple yet effective method improves diversity and delivers better performance, particularly at large test-time compute budgets.
content.type: text
content.value: 🎄 Diverse Verifier Tree Search (DVTS): An unpublished extension we developed to the verifier-guided tree search technique. This simple yet effective method improves diversity and delivers better performance, particularly at large test-time compute budgets.
content.type: new_line
content.type: new_line
content.raw: 🧭 Search and Learn: A lightweight toolkit for implementing search strategies with LLMs and built for speed with vLLM
content.type: text
content.value: 🧭 Search and Learn: A lightweight toolkit for implementing search strategies with LLMs and built for speed with vLLM
content.type: new_line
content.type: new_line
content.raw: Here's the links:
content.type: text
content.value: Here's the links:
content.type: new_line
content.type: new_line
content.raw: - Blog post: 
content.type: text
content.value: - Blog post: 
content.raw: https://huggingface.co/spaces/HuggingFaceH4/blogpost-scaling-test-time-compute
content.id: HuggingFaceH4/blogpost-scaling-test-time-compute
content.type: space
content.type: resource
content.url: https://huggingface.co/spaces/HuggingFaceH4/blogpost-scaling-test-time-compute
content.type: new_line
content.type: new_line
content.raw: - Code: 
content.type: text
content.value: - Code: 
content.href: https://github.com/huggingface/search-and-learn
content.raw: https://github.com/huggingface/search-and-learn
content.type: link
content.type: new_line
content.type: new_line
content.raw: Enjoy!
content.type: text
content.value: Enjoy!
rawContent: We outperform Llama 70B with Llama 3B on hard math by scaling test-time compute 🔥
  
  How? By combining step-wise reward models with tree search algorithms :)
  
  We show that smol models can match or exceed the performance of their much larger siblings when given enough "time to think"
  
  We're open sourcing the full recipe and sharing a detailed blog post.
  
  In our blog post we cover:
  
  📈 Compute-optimal scaling: How we implemented DeepMind's recipe to boost the mathematical capabilities of open models at test-time.
  
  🎄 Diverse Verifier Tree Search (DVTS): An unpublished extension we developed to the verifier-guided tree search technique. This simple yet effective method improves diversity and delivers better performance, particularly at large test-time compute budgets.
  
  🧭 Search and Learn: A lightweight toolkit for implementing search strategies with LLMs and built for speed with vLLM
  
  Here's the links:
  
  - Blog post: https://huggingface.co/spaces/HuggingFaceH4/blogpost-scaling-test-time-compute
  
  - Code: https://github.com/huggingface/search-and-learn
  
  Enjoy!
reactions.reaction: 🔥
reactions.users: clem anakin87 reonyy SultanR howcouldyou shetumohanto hull11 Dref360 fdaudens robb-0 coderfpv linoyts qgallouedec lunarflu mankness victor CaminantErrante Joseph717171 Frobenius hhhhzy ZPaimhigh GPT007 amenur s3nh AtAndDev Zilikon takarajordan Ashoka74 spyker77
reactions.reaction: ❤️
reactions.users: clem reonyy shetumohanto hull11 Dref360 g-ronimo nicolas-perreaux linoyts lunarflu CaminantErrante Joseph717171 Ultraviolet2zwx s3nh AtAndDev
reactions.reaction: 👀
reactions.users: John6666 clem reonyy Austin9 lunarflu s3nh AtAndDev daqc
reactions.reaction: 🚀
reactions.users: prithivMLmods reonyy lunarflu philipp-zettl amenur batuergun takarajordan
reactions.reaction: 👍
reactions.users: hull11 lunarflu nicolollo CaminantErrante
commentators._id: 6261dd2818176506fab4d1e0
commentators.avatarUrl: /avatars/75b361ef2adb04cbefb71e79ee0b6380.svg
commentators.fullname: Swapan jain
commentators.name: hull11
commentators.type: user
commentators._id: 64d694929a6a7ae984109bc0
commentators.avatarUrl: /avatars/1ab365eb2348d2dd7e448d857b552e65.svg
commentators.fullname: Jeremie Tisby
commentators.name: Frobenius
commentators.type: user