OpenThoughts: Data Recipes for Reasoning Models
Reasoning models have made rapid progress on many benchmarks involving math,
code, and science. Yet, there are still many open questions about the best
training recipes for reasoning since state-of-the-art models often rely on
proprietary datasets with little to no public information available. To address
this, the goal of the OpenThoughts project is to create open-source datasets
for training reasoning models. After initial explorations, our OpenThoughts2-1M
dataset led to OpenThinker2-32B, the first model trained on public reasoning
data to match DeepSeek-R1-Distill-32B on standard reasoning benchmarks such as
AIME and LiveCodeBench. We then improve our dataset further by systematically
investigating each step of our data generation pipeline with 1,000+ controlled
experiments, which led to OpenThoughts3. Scaling the pipeline to 1.2M examples
and using QwQ-32B as teacher yields our OpenThinker3-7B model, which achieves
state-of-the-art results: 53% on AIME 2025, 51% on LiveCodeBench 06/24-01/25,
and 54% on GPQA Diamond. All of our datasets and models are available on
https://openthoughts.ai.
68417762d777f13c594dd03c
Etash Guha
68417762d777f13c594dd03d
Ryan Marten
claimed_verified
2025-06-07T05:49:20.703Z
626c182a030a6e7363b6fe0a
https://cdn-avatars.huggingface.co/v1/production/uploads/626c182a030a6e7363b6fe0a/NaMcIOPVgJ6JFt8fojZWU.jpeg
Ryan Marten
user
ryanmarten
68417762d777f13c594dd03e
Sedrick Keh
68417762d777f13c594dd03f
Negin Raoof
68417762d777f13c594dd040
Georgios Smyrnis
68417762d777f13c594dd041
Hritik Bansal
68417762d777f13c594dd042
Marianna Nezhurina
claimed_verified
2025-06-07T05:49:22.779Z
62500f361684e0335e527bc6
/avatars/8d2bc4c9cfa8ea82049196431cc3ebea.svg
Marianna Nezhurina
user
marianna13
68417762d777f13c594dd043
Jean Mercat
68417762d777f13c594dd044
Trung Vu
claimed_verified
2025-06-11T08:36:55.579Z
6338cb22768611eccab73983
https://cdn-avatars.huggingface.co/v1/production/uploads/6338cb22768611eccab73983/AgdbEwS8TSWZS2vOLkR2u.jpeg
Trung Vu
user
trungtvu
68417762d777f13c594dd045
Zayne Sprague
68417762d777f13c594dd046
Ashima Suvarna
claimed_verified
2025-07-10T09:13:01.862Z
628c29a54c5a62a1d216c560
/avatars/d21b4da766f87f47228112958666643b.svg
Ashima Suvarna
user
Ashima
68417762d777f13c594dd047
Benjamin Feuer
claimed_verified
2025-06-07T05:49:16.121Z
62f7f4efe7c1c9bf10c81465
https://cdn-avatars.huggingface.co/v1/production/uploads/62f7f4efe7c1c9bf10c81465/AYlOg0fkP1o4GAP-8Y3xt.jpeg
Benjamin Feuer
user
penfever
68417762d777f13c594dd048
Liangyu Chen
68417762d777f13c594dd049
Zaid Khan
68417762d777f13c594dd04a
Eric Frankel
68417762d777f13c594dd04b
Sachin Grover
68417762d777f13c594dd04c
Caroline Choi
68417762d777f13c594dd04d
Niklas Muennighoff
68417762d777f13c594dd04e
Shiye Su
68417762d777f13c594dd04f
Wanjia Zhao
68417762d777f13c594dd050
John Yang
68417762d777f13c594dd051
Shreyas Pimpalgaonkar
claimed_verified
2025-06-06T07:41:50.414Z
6444e4417a7b94ddc2d14e1d
https://cdn-avatars.huggingface.co/v1/production/uploads/6444e4417a7b94ddc2d14e1d/kC9bUAHujBf2XQs1c2QfS.png
Shreyas Pimpalgaonkar
user
pimpalgaonkar
68417762d777f13c594dd052
Kartik Sharma
68417762d777f13c594dd053
Charlie Cheng-Jie Ji
68417762d777f13c594dd054
Yichuan Deng
claimed_verified
2025-06-06T07:41:52.871Z
63f39ca90be81bdc5d94acc5
/avatars/2eb069023671d8a9c118dd3c771d2d74.svg
Ethan Deng
user
SGEthan
68417762d777f13c594dd055
Sarah Pratt
68417762d777f13c594dd056
Vivek Ramanujan
68417762d777f13c594dd057
Jon Saad-Falcon
68417762d777f13c594dd058
Jeffrey Li
68417762d777f13c594dd059
Achal Dave
68417762d777f13c594dd05a
Alon Albalak
claimed_verified
2025-06-07T05:49:18.246Z
611a7ec4289467cafea62d13
https://cdn-avatars.huggingface.co/v1/production/uploads/611a7ec4289467cafea62d13/pck-0fmPQkoU7yzh6-WoL.jpeg
Alon Albalak
user
alon-albalak
68417762d777f13c594dd05b
Kushal Arora
68417762d777f13c594dd05c
Blake Wulfe
68417762d777f13c594dd05d
Chinmay Hegde
claimed_verified
2025-06-07T05:49:13.873Z
631620f6894404e25068856f
/avatars/52c30caa0ee11347f82420a14ec19996.svg
Chinmay Hegde
user
chegde
68417762d777f13c594dd05e
Greg Durrett
68417762d777f13c594dd05f
Sewoong Oh
68417762d777f13c594dd060
Mohit Bansal
68417762d777f13c594dd061
Saadia Gabriel
68417762d777f13c594dd062
Aditya Grover
68417762d777f13c594dd063
Kai-Wei Chang
68417762d777f13c594dd064
Vaishaal Shankar
68417762d777f13c594dd065
Aaron Gokaslan
68417762d777f13c594dd066
Mike A. Merrill
68417762d777f13c594dd067
Tatsunori Hashimoto
68417762d777f13c594dd068
Yejin Choi
68417762d777f13c594dd069
Jenia Jitsev
claimed_verified
2025-06-16T07:17:50.768Z
6355b485b8b79340d4630dd5
https://cdn-avatars.huggingface.co/v1/production/uploads/6355b485b8b79340d4630dd5/HIZO4ybweRy48VdCtk2MB.jpeg
Jenia Jitsev
user
JJitsev
68417762d777f13c594dd06a
Reinhard Heckel
68417762d777f13c594dd06b
Maheswaran Sathiamoorthy
68417762d777f13c594dd06c
Alexandros G. Dimakis
68417762d777f13c594dd06d
Ludwig Schmidt
OpenThoughts: Data Recipes for Reasoning Models
Reasoning models have made rapid progress on many benchmarks involving math,
code, and science. Yet, there are still many open questions about the best
training recipes for reasoning since state-of-the-art models often rely on
proprietary datasets with little to no public information available. To address
this, the goal of the OpenThoughts project is to create open-source datasets
for training reasoning models. After initial explorations, our OpenThoughts2-1M
dataset led to OpenThinker2-32B, the first model trained on public reasoning
data to match DeepSeek-R1-Distill-32B on standard reasoning benchmarks such as
AIME and LiveCodeBench. We then improve our dataset further by systematically
investigating each step of our data generation pipeline with 1,000+ controlled
experiments, which led to OpenThoughts3. Scaling the pipeline to 1.2M examples
and using QwQ-32B as teacher yields our OpenThinker3-7B model, which achieves
state-of-the-art results: 53% on AIME 2025, 51% on LiveCodeBench 06/24-01/25,
and 54% on GPQA Diamond. All of our datasets and models are available on
https://openthoughts.ai.
The OpenThoughts project created open-source datasets leading to reasoning models that match or exceed state-of-the-art benchmarks in math, code, and science.
reasoning models OpenThoughts project OpenThoughts2-1M OpenThinker2-32B DeepSeek-R1-Distill-32B standard reasoning benchmarks AIME LiveCodeBench OpenThoughts3 OpenThinker3-7B GPQA Diamond