the soft prompts for the k-th source task, denoted as ˆPk, can be
decomposed into the shared prompts across all source tasks P ∗
and a task-specific low-rank matrix Wk. The decomposition is
k ), where ⊙ denotes
given by ˆPk = P ∗ ⊙ Wk = P ∗ ⊙ (uk ⊗ vT
the Hadamard product, ⊗ denotes the Kronecker product, and
uk and vk are task-specific vectors for the task k.
Parameter-EfficientFine-TuningMethods