content.raw: We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!
content.type: text
content.value: We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!
content.type: new_line
content.type: new_line
content.raw: 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.
content.type: text
content.value: 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.
content.type: new_line
content.type: new_line
content.raw: 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.
content.type: text
content.value: 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.
content.type: new_line
content.type: new_line
content.raw: 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.
content.type: text
content.value: 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.
content.type: new_line
content.type: new_line
content.raw: Follow along: 
content.type: text
content.value: Follow along: 
content.href: https://github.com/huggingface/open-r1
content.raw: https://github.com/huggingface/open-r1
content.type: link
rawContent: We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!
  
  🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.
  
  🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.
  
  🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.
  
  Follow along: https://github.com/huggingface/open-r1
reactions.reaction: 🔥
reactions.users: eliebak plaguss eslamhesham ChuGyouk ZennyKenny ibvhim John6666 dingo-actual Kukedlc mooraslan Svngoku DataSoul xiaoqianWX aust-t Rupesh707 paiml edwixx CodeRayZhu loubnabnl tattrongvu oliviermills akahana damerajee maharshpatelx djuna learn2pro AkimfromParis HyperAutomata sepal KingNish Hugobartwisch jundeli kokoslon varun4 ginipick rafaelsandroni zys5945 Nielly victor masalinas seek007 FaizAalam RecViking Mike-plotpointe Mikehade01 chocho qgallouedec natalika
reactions.reaction: 🚀
reactions.users: eliebak plaguss John6666 Kukedlc anshon frntn damerajee t1u1 KingNish kokoslon ginipick Nielly mischeiwiller Ji-Xiang
reactions.reaction: 🤗
reactions.users: John6666 Kukedlc poterliu Ukdah damerajee KingNish kokoslon
reactions.reaction: 👀
reactions.users: ginipick
reactions.reaction: 👍
reactions.users: msplits
commentators._id: 6482514a0a72542864ca9e18
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6482514a0a72542864ca9e18/NnCokKRniMf8xceQPgvjR.jpeg
commentators.fullname: Olivier
commentators.name: oliviermills
commentators.type: user
commentators._id: 659b1661e1604bf996c8e5b9
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/V7vMML8To-3xpY31cw2dd.jpeg
commentators.fullname: venkat
commentators.name: sloshywings
commentators.type: user
commentators._id: 6562fe8fabefee6a6b0c72ed
commentators.avatarUrl: /avatars/522341451dd1e99ddf799f3b9875e5d0.svg
commentators.fullname: Nourin Ahmed
commentators.name: nourin
commentators.type: user