Every Expert Matters: Towards Effective Knowledge Distillation for Mixture-of-Experts Language Models
Paper
•
2502.12947
•
Published
ChuGyouk PRO
ChuGyouk
AI & ML interests
LLM(LMM) RL & Medical AI
Recent Activity
liked
a dataset
about 10 hours ago
pufanyi/MIMICIT
liked
a dataset
2 days ago
AIDC-AI/Ovis-dataset
liked
a model
5 days ago
lemon07r/Qwen3-R1-SLERP-Q3T-8B
Organizations
None yet
authored
a
paper
4 months ago