7 1 19

Olivier

oliviermills

https://oliviermills.com

AI & ML interests

LLMs, Data, AI for non-profits

Recent Activity

liked a dataset about 20 hours ago

ministere-culture/comparia-conversations

commented on a paper about 1 month ago

Beyond Release: Access Considerations for Generative AI Systems

reacted to lewtun's post with 🔥 4 months ago

We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open! 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1. 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code. 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training. Follow along: https://github.com/huggingface/open-r1

View all activity

Organizations

oliviermills's activity

liked a dataset about 20 hours ago

ministere-culture/comparia-conversations

Viewer • Updated 4 days ago • 175k • 226 • 39

commented a paper about 1 month ago

Beyond Release: Access Considerations for Generative AI Systems

Paper • 2502.16701 • Published Feb 23 • 16 •

reacted to lewtun's post with 🔥 4 months ago

Post

10387

We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!

🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.

🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.

🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.

Follow along: https://github.com/huggingface/open-r1