Scaling Vision with Sparse Mixture of Experts
Paper
•
2106.05974
•
Published
•
3
Papers - MoE - Image
-
-
Routers in Vision Mixture of Experts: An Empirical Study
Paper • 2401.15969 • Published • 2 -
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts
Paper • 2206.02770 • Published • 3 -
Experts Weights Averaging: A New General Training Scheme for Vision Transformers
Paper • 2308.06093 • Published • 2 -
Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks
Paper • 2306.04073 • Published • 2 -
A Mixture of Expert Approach for Low-Cost Customization of Deep Neural Networks
Paper • 1811.00056 • Published • 2 -
Balanced Mixture of SuperNets for Learning the CNN Pooling Architecture
Paper • 2306.11982 • Published • 2 -
Long-tailed Recognition by Routing Diverse Distribution-Aware Experts
Paper • 2010.01809 • Published • 2 -
MoE-LLaVA: Mixture of Experts for Large Vision-Language Models
Paper • 2401.15947 • Published • 49