[47] B. Zi, X. Qi, L. Wang, J. Wang, K.-F. Wong, and L. Zhang, “Delta-lora:
Fine-tuning high-rank parameters with the delta of low-rank matrices,”
arXiv preprint arXiv:2309.02411, 2023.

[48] M. Zhang, C. Shen, Z. Yang, L. Ou, X. Yu, B. Zhuang et al., “Prun-
ing meets low-rank parameter-efficient fine-tuning,” arXiv preprint
arXiv:2305.18403, 2023.

[49] T. Dettmers, A. Pagnoni, A. Holtzman, and L. Zettlemoyer, “Qlora: Ef-
ficient finetuning of quantized llms,” arXiv preprint arXiv:2305.14314,
2023.

[50] Y. Xu, L. Xie, X. Gu, X. Chen, H. Chang, H. Zhang, Z. Chen, X. Zhang,
and Q. Tian, “Qa-lora: Quantization-aware low-rank adaptation of large
language models,” arXiv preprint arXiv:2309.14717, 2023.

[51] Y. Li, Y. Yu, C. Liang, P. He, N. Karampatziakis, W. Chen, and
T. Zhao, “Loftq: Lora-fine-tuning-aware quantization for large language
models,” arXiv preprint arXiv:2310.08659, 2023.
Parameter-EfficientFine-TuningMethods