Buffer Overflow in Mixture of Experts
<|reference_start|>Buffer Overflow in Mixture of Experts: Mixture of Experts (MoE) has become a key ingredient for scaling large foundation models while keeping inference costs steady. We show that expert routing strategies that have cross-batch dependencies are vulnerable to attacks. Malicious queries can be sent to a model and can affect a model's output on other benign queries if they are grouped in the same batch. We demonstrate this via a proof-of-concept attack in a toy experimental setting.<|reference_end|>
@article{hayes2024buffer,
    title={Buffer Overflow in Mixture of Experts},
    author={Jamie Hayes, Ilia Shumailov, Itay Yona},
    journal={arXiv preprint arXiv:2402.05526},
    year={2024},
    archivePrefix={arXiv},
    eprint={2402.05526},
    primaryClass={cs.CR cs.LG}
}