content.raw: The latest o1 model from OpenAI is still unable to answer 9.11 > 9.9 correctly 🤔
content.type: text
content.value: The latest o1 model from OpenAI is still unable to answer 9.11 > 9.9 correctly 🤔
content.type: new_line
content.type: new_line
content.raw: A possible explanation? Tokenization - and our latest work investigates how it affects a model's ability to do math!
content.type: text
content.value: A possible explanation? Tokenization - and our latest work investigates how it affects a model's ability to do math!
content.type: new_line
content.type: new_line
content.raw: In this blog post, we discuss:
content.type: text
content.value: In this blog post, we discuss:
content.type: new_line
content.raw: 🔢 The different ways numbers are tokenized in modern LLMs
content.type: text
content.value: 🔢 The different ways numbers are tokenized in modern LLMs
content.type: new_line
content.raw: 🧪 Our detailed approach in comparing these various methods
content.type: text
content.value: 🧪 Our detailed approach in comparing these various methods
content.type: new_line
content.raw: 🥪 How we got a free boost in arithmetic performance by adding a few lines of code to the base Llama 3 tokenizer
content.type: text
content.value: 🥪 How we got a free boost in arithmetic performance by adding a few lines of code to the base Llama 3 tokenizer
content.type: new_line
content.raw: 👑 and a definitive, best tokenization method for math in LLMs!
content.type: text
content.value: 👑 and a definitive, best tokenization method for math in LLMs!
content.type: new_line
content.type: new_line
content.raw: Check out our work here: 
content.type: text
content.value: Check out our work here: 
content.raw: https://huggingface.co/spaces/huggingface/number-tokenization-blog
content.id: huggingface/number-tokenization-blog
content.type: space
content.type: resource
content.url: https://huggingface.co/spaces/huggingface/number-tokenization-blog
rawContent: The latest o1 model from OpenAI is still unable to answer 9.11 > 9.9 correctly 🤔
  
  A possible explanation? Tokenization - and our latest work investigates how it affects a model's ability to do math!
  
  In this blog post, we discuss:
  🔢 The different ways numbers are tokenized in modern LLMs
  🧪 Our detailed approach in comparing these various methods
  🥪 How we got a free boost in arithmetic performance by adding a few lines of code to the base Llama 3 tokenizer
  👑 and a definitive, best tokenization method for math in LLMs!
  
  Check out our work here: https://huggingface.co/spaces/huggingface/number-tokenization-blog
reactions.reaction: 🔥
reactions.users: thomwolf timmylai SamJoshua robbinhan victor linoyts
reactions.reaction: 🧠
reactions.users: prithivMLmods John6666 Felladrin
reactions.reaction: ❤️
reactions.users: thomwolf
commentators._id: 6048ea0c0f59ab4b614f1836
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6048ea0c0f59ab4b614f1836/8Eg8IyPtJgOHmywcJ7E8a.jpeg
commentators.fullname: RITABRATA MAITI
commentators.name: ritabratamaiti
commentators.type: user
commentators._id: 630f3e4002ce39336c411048
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/630f3e4002ce39336c411048/Wlldb-4EU5poO6JYmZp2I.png
commentators.fullname: alkinun
commentators.name: AtAndDev
commentators.type: user