🤯 𝗔 𝗻𝗲𝘄 𝟳𝟬𝗕 𝗼𝗽𝗲𝗻-𝘄𝗲𝗶𝗴𝗵𝘁𝘀 𝗟𝗟𝗠 𝗯𝗲𝗮𝘁𝘀 𝗖𝗹𝗮𝘂𝗱𝗲-𝟯.𝟱-𝗦𝗼𝗻𝗻𝗲𝘁 𝗮𝗻𝗱 𝗚𝗣𝗧-𝟰𝗼!
text
🤯 𝗔 𝗻𝗲𝘄 𝟳𝟬𝗕 𝗼𝗽𝗲𝗻-𝘄𝗲𝗶𝗴𝗵𝘁𝘀 𝗟𝗟𝗠 𝗯𝗲𝗮𝘁𝘀 𝗖𝗹𝗮𝘂𝗱𝗲-𝟯.𝟱-𝗦𝗼𝗻𝗻𝗲𝘁 𝗮𝗻𝗱 𝗚𝗣𝗧-𝟰𝗼!
new_line
new_line
@mattshumer
mention
mattshumer
, CEO from Hyperwrite AI, had an idea he wanted to try out: why not fine-tune LLMs to always output their thoughts in specific parts, delineated by <thinking> tags?
text
, CEO from Hyperwrite AI, had an idea he wanted to try out: why not fine-tune LLMs to always output their thoughts in specific parts, delineated by <thinking> tags?
new_line
new_line
Even better: inside of that, you could nest other sections, to reflect critically on previous output. Let’s name this part <reflection>. Planning is also put in a separate step.
text
Even better: inside of that, you could nest other sections, to reflect critically on previous output. Let’s name this part <reflection>. Planning is also put in a separate step.
new_line
new_line
He named the method “Reflection tuning” and set out to fine-tune a Llama-3.1-70B with it.
text
He named the method “Reflection tuning” and set out to fine-tune a Llama-3.1-70B with it.
new_line
new_line
Well it turns out, it works mind-boggingly well!
text
Well it turns out, it works mind-boggingly well!
new_line
new_line
🤯 Reflection-70B beats GPT-4o, Sonnet-3.5, and even the much bigger Llama-3.1-405B!
text
🤯 Reflection-70B beats GPT-4o, Sonnet-3.5, and even the much bigger Llama-3.1-405B!
new_line
new_line
𝗧𝗟;𝗗𝗥
text
𝗧𝗟;𝗗𝗥
new_line
🥊 This new 70B open-weights model beats GPT-4o, Claude Sonnet, et al.
text
🥊 This new 70B open-weights model beats GPT-4o, Claude Sonnet, et al.
new_line
⏰ 405B in training, coming soon
text
⏰ 405B in training, coming soon
new_line
📚 Report coming next week
text
📚 Report coming next week
new_line
⚙️ Uses GlaiveAI synthetic data
text
⚙️ Uses GlaiveAI synthetic data
new_line
🤗 Available on HF!
text
🤗 Available on HF!
new_line
new_line
I’m starting an Inference Endpoint right now for this model to give it a spin!
text
I’m starting an Inference Endpoint right now for this model to give it a spin!
new_line
new_line
Check it out 👉 
text
Check it out 👉 
https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B
mattshumer/Reflection-Llama-3.1-70B
model
resource
https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B
🤯 𝗔 𝗻𝗲𝘄 𝟳𝟬𝗕 𝗼𝗽𝗲𝗻-𝘄𝗲𝗶𝗴𝗵𝘁𝘀 𝗟𝗟𝗠 𝗯𝗲𝗮𝘁𝘀 𝗖𝗹𝗮𝘂𝗱𝗲-𝟯.𝟱-𝗦𝗼𝗻𝗻𝗲𝘁 𝗮𝗻𝗱 𝗚𝗣𝗧-𝟰𝗼!

@mattshumer, CEO from Hyperwrite AI, had an idea he wanted to try out: why not fine-tune LLMs to always output their thoughts in specific parts, delineated by <thinking> tags?

Even better: inside of that, you could nest other sections, to reflect critically on previous output. Let’s name this part <reflection>. Planning is also put in a separate step.

He named the method “Reflection tuning” and set out to fine-tune a Llama-3.1-70B with it.

Well it turns out, it works mind-boggingly well!

🤯 Reflection-70B beats GPT-4o, Sonnet-3.5, and even the much bigger Llama-3.1-405B!

𝗧𝗟;𝗗𝗥
🥊 This new 70B open-weights model beats GPT-4o, Claude Sonnet, et al.
⏰ 405B in training, coming soon
📚 Report coming next week
⚙️ Uses GlaiveAI synthetic data
🤗 Available on HF!

I’m starting an Inference Endpoint right now for this model to give it a spin!

Check it out 👉 https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B
👀
John6666 osanseviero DataSoul xi0v Joseph717171
👍
TahirC Yuuru iandeanschaefer trollek Joseph717171
🤗
louisbrulenaudet YaTharThShaRma999 Joseph717171
66dc31158b119f5e89df1a6a
/avatars/1aea33e7602a81f6b6ed98412dda9b41.svg
GR
gr0010
user
63596f9f0cd44992263f2105
https://cdn-avatars.huggingface.co/v1/production/uploads/63596f9f0cd44992263f2105/4CCZECojd7tkbOxMryiww.png
Trolle Karlsson
trollek
user
64175bc2b03817ada642291f
https://cdn-avatars.huggingface.co/v1/production/uploads/64175bc2b03817ada642291f/V3mhc8Y0saSgXbp--2HcE.png
Kh
raidhon
user