retrieval brings more information and lower efficiency. As
for ”how to use” the retrieved data, integration techniques
have been developed across various levels of the model
[Khattab et al., 2022],
architecture,
intermediate
lay-
ers [Liang et al., 2023]. Although the “intermediate” and
“output layers” are more effective, there are problems with
the need for training and low efficiency.
RAG forLargeLanguageModels-ASurvey