How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?
The performance of Large Language Models (LLMs) on many tasks is greatly
limited by the knowledge learned during pre-training and stored in the model's
parameters. Low-rank adaptation (LoRA) is a popular and efficient training
technique for updating or domain-specific adaptation of LLMs. In this study, we
investigate how new facts can be incorporated into the LLM using LoRA without
compromising the previously learned knowledge. We fine-tuned
Llama-3.1-8B-instruct using LoRA with varying amounts of new knowledge. Our
experiments have shown that the best results are obtained when the training
data contains a mixture of known and new facts. However, this approach is still
potentially harmful because the model's performance on external
question-answering benchmarks declines after such fine-tuning. When the
training data is biased towards certain entities, the model tends to regress to
few overrepresented answers. In addition, we found that the model becomes more
confident and refuses to provide an answer in only few cases. These findings
highlight the potential pitfalls of LoRA-based LLM updates and underscore the
importance of training data composition and tuning parameters to balance new
knowledge integration and general model capabilities.
67b83fd69fb3eedaf6d0aef3
Sergey Pletenev
claimed_verified
2025-02-21T09:49:33.682Z
5dfa8e07da6d0311fd3d5430
https://cdn-avatars.huggingface.co/v1/production/uploads/1651090418656-5dfa8e07da6d0311fd3d5430.png
Sergey Pletenev
user
memyprokotow
67b83fd69fb3eedaf6d0aef4
Maria Marina
claimed_verified
2025-02-21T14:42:47.555Z
660ee18e2dcd816ad14b3739
https://cdn-avatars.huggingface.co/v1/production/uploads/660ee18e2dcd816ad14b3739/2pPMurtSOHMA96eVk0k7w.jpeg
Maria Marina
user
zlatamaria
67b83fd69fb3eedaf6d0aef5
Daniil Moskovskiy
claimed_verified
2025-02-21T14:42:49.828Z
61ade264f602880813dbe10b
/avatars/a92dea7d853bbabbf60b351c207b6875.svg
Daniil Moskovskiy
user
etomoscow
67b83fd69fb3eedaf6d0aef6
Vasily Konovalov
claimed_verified
2025-05-12T06:51:55.444Z
622b1f6b9f6139daa8e998ce
/avatars/842719c100a5969be75d04da97333675.svg
Vasily Konovalov
user
Vasily
67b83fd69fb3eedaf6d0aef7
Pavel Braslavski
67b83fd69fb3eedaf6d0aef8
Alexander Panchenko
67b83fd69fb3eedaf6d0aef9
Mikhail Salnikov
extracted_confirmed
2025-02-21T09:01:04.770Z
62bd6c6baaf1480f1aa2222e
/avatars/fd92ae2986d435a47eb1e382ac11d8e0.svg
Mikhail Salnikov
user
msalnikov
How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?
The performance of Large Language Models (LLMs) on many tasks is greatly
limited by the knowledge learned during pre-training and stored in the model's
parameters. Low-rank adaptation (LoRA) is a popular and efficient training
technique for updating or domain-specific adaptation of LLMs. In this study, we
investigate how new facts can be incorporated into the LLM using LoRA without
compromising the previously learned knowledge. We fine-tuned
Llama-3.1-8B-instruct using LoRA with varying amounts of new knowledge. Our
experiments have shown that the best results are obtained when the training
data contains a mixture of known and new facts. However, this approach is still
potentially harmful because the model's performance on external
question-answering benchmarks declines after such fine-tuning. When the
training data is biased towards certain entities, the model tends to regress to
few overrepresented answers. In addition, we found that the model becomes more
confident and refuses to provide an answer in only few cases. These findings
highlight the potential pitfalls of LoRA-based LLM updates and underscore the
importance of training data composition and tuning parameters to balance new
knowledge integration and general model capabilities.
Low-rank adaptation (LoRA) effectively updates LLMs with new knowledge but risks degrading performance on external benchmarks due to data bias and overconfidence.
Low-rank adaptation LoRA Large Language Models LLMs fine-tuning Llama-3.1-8B-instruct question-answering benchmarks overrepresented answers confidence general model capabilities