Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
Paper • 2604.13016 • Published • 94
Chandler.JQ.ZHANG
JqzAugUST
AI & ML interests
(Master of Science, HKUST) NLP, Sparse Attn. Trying to play with GPU Kernels.
Recent Activity
upvoted a paper about 1 month ago
Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe liked a model 3 months ago
openbmb/MiniCPM-SALA liked a dataset 3 months ago
openbmb/UltraData-MathOrganizations
upvoted a paper about 1 month ago
liked a
model 3 months ago
liked a
dataset 3 months ago
upvoted a collection 3 months ago
upvoted a paper 8 months ago
liked a
model 8 months ago
updated a
Space 8 months ago
liked a
Space 8 months ago
published a
Space 8 months ago
liked a
Space 8 months ago