Every Expert Matters: Towards Effective Knowledge Distillation for Mixture-of-Experts Language Models
Paper
โข
2502.12947
โข
Published
ChuGyouk
ChuGyouk
AI & ML interests
LLM(LMM) RL & Medical AI
Recent Activity
liked
a dataset
3 days ago
li-lab/MMLU-ProX
liked
a Space
3 days ago
google/appoint-ready
Organizations
None yet
authored
a
paper
4 months ago