Hallucination in long text. Many tasks in NLG require the model to process long input texts, such
as multi-document summarization and generative question answering. We think adopting existing
approaches to a Longformer [8]-based model could help encode long inputs. Meanwhile, part of
dialogue systems need to generate long output text, in which the latter part may contradict history
generation. Therefore, reducing self-contradiction is also an important future direction.
SurveyofHallucinationinNatural Language Generation