C. Developing PEFT Library

Numerous PEFT methods have emerged, but employing
them is not a straightforward endeavor. To address this
the PEFT library8 and AdapterHub9 have been
challenge,
developed. These libraries integrate commonly used PEFT
methods such as prefix-tuning, LoRA, and AdaLoRA. With
just a few lines of code, users can directly invoke these
PEFT methods, simplifying their usage. Moreover, both the
PEFT and AdapterHub libraries offer a range of examples
illustrating how to apply these PEFT methods to various PLMs
and LLMs for fine-tuning downstream tasks. However, not
all PEFT methods are currently integrated into these two
libraries. Future efforts can be directed towards expanding
the integration of additional methods, further boosting the
application development of PEFT methods.

D. Explainability of PEFT Methods
Parameter-EfficientFine-TuningMethods