THEANINE: Revisiting Memory Management in Long-term Conversations with
  Timeline-augmented Response Generation
Large language models (LLMs) are capable of processing lengthy dialogue
histories during prolonged interaction with users without additional memory
modules; however, their responses tend to overlook or incorrectly recall
information from the past. In this paper, we revisit memory-augmented response
generation in the era of LLMs. While prior work focuses on getting rid of
outdated memories, we argue that such memories can provide contextual cues that
help dialogue systems understand the development of past events and, therefore,
benefit response generation. We present Theanine, a framework that augments
LLMs' response generation with memory timelines -- series of memories that
demonstrate the development and causality of relevant past events. Along with
Theanine, we introduce TeaFarm, a counterfactual-driven question-answering
pipeline addressing the limitation of G-Eval in long-term conversations.
Supplementary videos of our methods and the TeaBag dataset for TeaFarm
evaluation are in https://theanine-693b0.web.app/.
6671145dab84abdbee7765a2
Seo Hyun Kim
claimed_verified
2024-06-19T07:39:19.479Z
62e167813eb0730f6217c95e
/avatars/95a18009f725832646643d6169c2bc08.svg
Seo Hyun Kim
user
shkim0116
6671145dab84abdbee7765a3
Kai Tzu-iunn Ong
admin_assigned
2024-06-18T08:17:37.450Z
640ec2fd2f9c7b364d182735
https://cdn-avatars.huggingface.co/v1/production/uploads/640ec2fd2f9c7b364d182735/G5WxQXYEOaVL39rAoOI3Y.jpeg
kai tzu-iunn ong
user
ktio
6671145dab84abdbee7765a4
Taeyoon Kwon
admin_assigned
2024-06-18T08:38:18.918Z
636b529ef796304dd67d139c
/avatars/7a64d5095fcb1da558b52ad48177ad76.svg
Taeyoon Kwon
user
Connoriginal
6671145dab84abdbee7765a5
Namyoung Kim
6671145dab84abdbee7765a6
Keummin Ka
admin_assigned
2024-06-18T08:38:39.991Z
65f90edde7bb1e13196f0be7
/avatars/8585ca41e6720c84997f060796728654.svg
Keummin Ka
user
KEUMMin
6671145dab84abdbee7765a7
SeongHyeon Bae
6671145dab84abdbee7765a8
Yohan Jo
6671145dab84abdbee7765a9
Seung-won Hwang
admin_assigned
2024-06-18T08:38:55.832Z
665ef2f1d2d117e810441ebb
/avatars/2b12efb9297d9b61fe6dcd1af83e3748.svg
SeungWon Hwang
user
kevin1113dev
6671145dab84abdbee7765aa
Dongha Lee
claimed_verified
2024-10-21T12:14:17.465Z
61d4bb8a34cff1c8e64b6a2a
https://cdn-avatars.huggingface.co/v1/production/uploads/61d4bb8a34cff1c8e64b6a2a/eEXKbsXB9VK1sR8QqNPi7.png
Dongha Lee
user
donalee
6671145dab84abdbee7765ab
Jinyoung Yeo
admin_assigned
2024-06-18T08:39:28.825Z
6419ad74060a651c415eec62
/avatars/e7b060d0a45e3af1c7439948dbd60e34.svg
Jinyoung Yeom
user
geen02
THEANINE: Revisiting Memory Management in Long-term Conversations with
  Timeline-augmented Response Generation
Large language models (LLMs) are capable of processing lengthy dialogue
histories during prolonged interaction with users without additional memory
modules; however, their responses tend to overlook or incorrectly recall
information from the past. In this paper, we revisit memory-augmented response
generation in the era of LLMs. While prior work focuses on getting rid of
outdated memories, we argue that such memories can provide contextual cues that
help dialogue systems understand the development of past events and, therefore,
benefit response generation. We present Theanine, a framework that augments
LLMs' response generation with memory timelines -- series of memories that
demonstrate the development and causality of relevant past events. Along with
Theanine, we introduce TeaFarm, a counterfactual-driven question-answering
pipeline addressing the limitation of G-Eval in long-term conversations.
Supplementary videos of our methods and the TeaBag dataset for TeaFarm
evaluation are in https://theanine-693b0.web.app/.
Theanine enhances LLM response generation by integrating memory timelines, providing contextual cues for better understanding and recall of past events in dialogues.
memory-augmented response generation large language models LLMs memory timelines contextual cues dialogue systems Theanine TeaFarm counterfactual-driven question-answering TeaBag dataset