Distilled Reasoning Models with Activation Sparse

InfiniAI Lab
university
AI & ML interests
ML algorithms and systems
Recent Activity
View all activity
Collections
4
Reproduce Deepseek distilled models based on open-r1.
-
InfiniAILab/OpenR1-Qwen-3B-SFT-Instruct
Text Generation • Updated • 883 • 1 -
InfiniAILab/OpenR1-Qwen-7B-SFT-Instruct
Text Generation • Updated • 32 • 1 -
InfiniAILab/OpenR1-Qwen-7B-Math-Instruct
Text Generation • Updated • 20 -
InfiniAILab/OpenR1-Qwen-1.5B-SFT-Instruct
Text Generation • Updated • 15
models
19

InfiniAILab/Qwen2.5-Math-7B-Instruct-32k
Updated
•
31

InfiniAILab/OpenR1-Qwen-7B-Math-local-layerwise-B2048
Updated

InfiniAILab/OpenR1-Qwen-7B-Sparse-P25
Text Generation
•
Updated
•
165

InfiniAILab/OpenR1-Qwen-7B-local-ilv_4-packing-B2048
Updated
•
115

InfiniAILab/OpenR1-Qwen-7B-Sparse-P50
Text Generation
•
Updated
•
855

InfiniAILab/OpenR1-Qwen-7B-Math-dense-packing
Updated
•
4.3k

InfiniAILab/OpenR1-Qwen-7B-Math-local-ilv_4-packing-B2048
Updated
•
981

InfiniAILab/OpenR1-Qwen-7B-Math-local-ilv_4-packing-B4096
Updated
•
950

InfiniAILab/OpenR1-Qwen-7B-Sparse-P40
Text Generation
•
Updated
•
352

InfiniAILab/QwQ-32B-FP8
Updated
•
146
datasets
14
InfiniAILab/gsm8k
Viewer
•
Updated
•
1.32k
•
511
InfiniAILab/gsm_infinite_symbolic_32k
Viewer
•
Updated
•
3k
•
506
InfiniAILab/gsm_infinite_symbolic_16k
Viewer
•
Updated
•
3k
•
185
InfiniAILab/gsm_infinite_symbolic_8k
Viewer
•
Updated
•
3k
•
919
InfiniAILab/gsm_infinite_hard_16k
Viewer
•
Updated
•
47.5k
•
183
InfiniAILab/gsm_infinite_medium_16k
Viewer
•
Updated
•
39.8k
•
188
InfiniAILab/gsm_infinite_hard_32k
Viewer
•
Updated
•
47.2k
•
196
InfiniAILab/gsm_infinite_medium_32k
Viewer
•
Updated
•
40k
•
119
InfiniAILab/gsm_infinite_hard_8k
Viewer
•
Updated
•
47.2k
•
188
InfiniAILab/gsm_infinite_medium_8k
Viewer
•
Updated
•
38.6k
•
182