Introducing new decoding strategy

3.1
Decoding strategy generally involves designing
techniques that specifically target the generation
phase of a model. In terms of hallucination, the
techniques aim to reduce the occurrence of halluci-
nations in the generated outputs by guiding the gen-
eration phase towards authentic or context-specific
generation (Lango and Dusek, 2023). The follow-
ing techniques make use of the decoding strategy:
Context-Aware Decoding (CAD): (Shi et al.,
2023) present CAD, which follows a contrastive
output distribution that amplifies the difference be-
tween the output probabilities when a model is
used with and without context. CAD is particu-
larly effective in overriding a model’s prior knowl-
edge when it contradicts the provided context, lead-
ing to substantial improvements in tasks where re-
AComprehensiveSurveyofHallucinationMitigationTechniquesinLarge LanguageModels