Guiding (PKG) framework, which equips LLMs with a knowledge-guiding module to access relevant
knowledge without altering the LLMs’ parameters. These inference techniques then improve answer
accuracy compared to the naive prompting strategy using GPT-3.5-turbo. Currently, GPT-3.5-turbo
has also incorporated a retrieval plugin (OpenAI, 2023a) that accesses external knowledge to reduce
hallucinations.
For multi-agent dialogue, Cohen et al. (2023) facilitates a multi-turn interaction between the Ex-
aminee LLM that generated the claim and another Examiner LLM which introduces questions to
discover inconsistencies. Through the cross-examination process, performance on various QA tasks
is improved. Du et al. (2023) asks multiple language model instances to propose and debate their
individual responses and reasoning processes over multiple rounds to arrive at a common final answer,
which improves on multiple benchmarks.
ChatGPT’sOne-yearAnniversary-AreOpen-Source LargeLanguageModelsCatchingup