Every Expert Matters: Towards Effective Knowledge Distillation for Mixture-of-Experts Language Models
Paper
•
2502.12947
•
Published
ChuGyouk PRO
ChuGyouk
AI & ML interests
LLM(LMM) RL & Medical AI
Recent Activity
upvoted
a
collection
13 minutes ago
EAGLE3
liked
a model
about 2 hours ago
CohereLabs/command-a-translate-08-2025
liked
a dataset
1 day ago
openai/healthbench
Organizations
None yet
authored
a
paper
6 months ago