**Mixture-of-Experts**


### MoE





> [Mixture-of-Experts with Expert Choice Routing](https://ai.googleblog.com/2022/11/mixture-of-experts-with-expert-choice.html)

> [Outrageously Large Neural Networks: The Sparsely-Gated...](https://arxiv.org/abs/1701.06538)




