Rethinking On-Policy Distillation of Large Language Models II: One Training Example
Paper • 2609.04172 • Published • 97
EdenQiao
EdenQiao
·
AI & ML interests
None yet
Recent Activity
upvoted a paper 5 days ago
Rethinking On-Policy Distillation of Large Language Models II: One Training Example upvoted a paper 9 days ago
StudyBench: Can Self-Evolution Squeeze Textbooks for Olympiad Capability? liked a dataset 20 days ago
openbmb/Ultra-FineWeb-L1Organizations
None yet
upvoted a paper 5 days ago
upvoted a paper 9 days ago
liked a
dataset 20 days ago
upvoted a paper 28 days ago
liked a
Space 3 months ago
authored 3
papers 3 months ago
Mutual Enhancement of Large and Small Language Models with Cross-Silo Knowledge Transfer
Paper • 2312.05842 • Published • 1
ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
Paper • 2505.04881 • Published • 1
Rethinking the Role of Efficient Attention in Hybrid Architectures
Paper • 2606.15378 • Published • 20
upvoted 3
papers 3 months ago
δ-mem: Efficient Online Memory for Large Language Models
Paper • 2605.12357 • Published • 133
Rethinking the Role of Efficient Attention in Hybrid Architectures
Paper • 2606.15378 • Published • 20
ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
Paper • 2505.04881 • Published • 1
published 8
models 3 months ago
EdenQiao/Rethinking-Hybrid-ScalingLaw
Updated
EdenQiao/Rethinking-Hybrid-S5-SWA-128-Nope-100b
Updated • 165
EdenQiao/Rethinking-Hybrid-S5-SWA-128-Nope-100b-32k-5b
Updated • 72
EdenQiao/Rethinking-Hybrid-S5-SWA-128-100b
Updated • 110
EdenQiao/Rethinking-Hybrid-S5-SWA-128-100b-32k-5b
Updated • 79
EdenQiao/Rethinking-Hybrid-S5-full-100b
Updated • 205
EdenQiao/Rethinking-Hybrid-S5-full-100b-32k-5b
Updated • 80
EdenQiao/Rethinking-Hybrid-Constraint
Updated
updated a
model 3 months ago