[62] J. Chen, A. Zhang, X. Shi, M. Li, A. Smola, and D. Yang, “Parameter-
efficient fine-tuning design spaces,” in Proc. Int. Conf. Learn. Repre-
sentations, 2023.

[63] Y. Wang, S. Agarwal, S. Mukherjee, X. Liu, J. Gao, A. H. Awadallah,
and J. Gao, “AdaMix: Mixture-of-adaptations for parameter-efficient
model tuning,” in Proc. Conf. Empir. Methods Natural Lang. Process.,
2022, pp. 5744–5760.

[64] S. He, L. Ding, D. Dong, J. Zhang, and D. Tao, “SparseAdapter: An
easy approach for improving the parameter-efficiency of adapters,” in
Proc. Findings Conf. Empir. Methods Natural Lang. Process., 2022,
pp. 2184–2190.

[65] G. Zeng, P. Zhang, and W. Lu, “One network, many masks: Towards
more parameter-efficient transfer learning,” in Proc. Annu. Meeting
Assoc. Comput. Linguistics, 2023, pp. 7564–7580.

[66] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N.
Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Proc.
Adv. Neural Inf. Process. Syst., vol. 30, 2017.
Parameter-EfficientFine-TuningMethods