Communication-Efficient Byzantine-Resilient Federated Zero-Order Optimization
<|reference_start|>Communication-Efficient Byzantine-Resilient Federated Zero-Order Optimization: We introduce CYBER-0, the first zero-order optimization algorithm for memory-and-communication efficient Federated Learning, resilient to Byzantine faults. We show through extensive numerical experiments on the MNIST dataset and finetuning RoBERTa-Large that CYBER-0 outperforms state-of-the-art algorithms in terms of communication and memory efficiency while reaching similar accuracy. We provide theoretical guarantees on its convergence for convex loss functions.<|reference_end|>
@article{neto2024communication-efficient,
    title={Communication-Efficient Byzantine-Resilient Federated Zero-Order
  Optimization},
    author={Afonso de S'a Delgado Neto, Maximilian Egger, Mayank Bakshi, Rawad
  Bitar},
    journal={arXiv preprint arXiv:2406.14362},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.14362},
    primaryClass={cs.LG cs.AI}
}