tiple PEFT methods typically results in increased parameter
and memory usage, although it enhances performance. Hence,
an intriguing research direction involves investigating how
to leverage multiple PEFT methods to improve performance
while minimizing the number of trainable parameters.
Parameter-EfficientFine-TuningMethods