Unlocking Anticipatory Text Generation: A Constrained Approach for
  Faithful Decoding with Large Language Models
Large Language Models (LLMs) have demonstrated a powerful ability for text
generation. However, achieving optimal results with a given prompt or
instruction can be challenging, especially for billion-sized models.
Additionally, undesired behaviors such as toxicity or hallucinations can
manifest. While much larger models (e.g., ChatGPT) may demonstrate strength in
mitigating these issues, there is still no guarantee of complete prevention. In
this work, we propose formalizing text generation as a future-constrained
generation problem to minimize undesirable behaviors and enforce faithfulness
to instructions. The estimation of future constraint satisfaction, accomplished
using LLMs, guides the text generation process. Our extensive experiments
demonstrate the effectiveness of the proposed approach across three distinct
text generation tasks: keyword-constrained generation (Lin et al., 2020),
toxicity reduction (Gehman et al., 2020), and factual correctness in
question-answering (Gao et al., 2023).
6577d8d0224758a1fc667609
Lifu Tu
admin_assigned
2023-12-12T09:11:48.418Z
611d9648dcea95fcbbc5638e
/avatars/e94bf70da30ed5036e2c12a38b6fcad9.svg
Lifu Tu
user
tulifu
6577d8d0224758a1fc66760a
Semih Yavuz
admin_assigned
2023-12-12T09:11:55.830Z
64f8a68e33fd3f0fcb7810b5
/avatars/cb5ea85e9ed513efaf24a9f36869f98f.svg
Semih Yavuz
user
syavuz
6577d8d0224758a1fc66760b
Jin Qu
admin_assigned
2023-12-12T09:12:20.401Z
652cfdd22aa5b27c770eb21d
/avatars/8ddec681486d8cfc6f93d25b422ccdba.svg
qu jin
user
JinWendy
6577d8d0224758a1fc66760c
Jiacheng Xu
admin_assigned
2023-12-12T09:12:41.223Z
631983d5cb116eab31df5821
/avatars/6a42c842a9439241ead2ace1d79fc32c.svg
Jiacheng Xu
user
jcxu
6577d8d0224758a1fc66760d
Rui Meng
admin_assigned
2023-12-12T09:13:05.764Z
64100337c025ddf6189c2794
/avatars/3a5b4757604e5d2e8f231af59544dd28.svg
Rui Meng
user
mengrui6351
6577d8d0224758a1fc66760e
Caiming Xiong
admin_assigned
2023-12-12T09:13:12.794Z
649dbcc4e0fff1ed099dc80a
/avatars/c87c273ca628dbcddccbf1ee19b2ce33.svg
Caiming Xiong
user
cxiong
6577d8d0224758a1fc66760f
Yingbo Zhou
admin_assigned
2023-12-12T09:13:19.724Z
649bc93758d8b19de0c7785f
/avatars/3ed9473aee23d99f4ee949d3705089ea.svg
Yingbo Zhou
user
yingbozhou
Unlocking Anticipatory Text Generation: A Constrained Approach for
  Faithful Decoding with Large Language Models
Large Language Models (LLMs) have demonstrated a powerful ability for text
generation. However, achieving optimal results with a given prompt or
instruction can be challenging, especially for billion-sized models.
Additionally, undesired behaviors such as toxicity or hallucinations can
manifest. While much larger models (e.g., ChatGPT) may demonstrate strength in
mitigating these issues, there is still no guarantee of complete prevention. In
this work, we propose formalizing text generation as a future-constrained
generation problem to minimize undesirable behaviors and enforce faithfulness
to instructions. The estimation of future constraint satisfaction, accomplished
using LLMs, guides the text generation process. Our extensive experiments
demonstrate the effectiveness of the proposed approach across three distinct
text generation tasks: keyword-constrained generation (Lin et al., 2020),
toxicity reduction (Gehman et al., 2020), and factual correctness in
question-answering (Gao et al., 2023).
Formalizing text generation as a future-constrained problem improves faithfulness to instructions and limits toxicity and hallucinations in large language models.
future-constrained generation undesirable behaviors toxicity hallucinations text generation keyword-constrained generation factual correctness question-answering