Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Peter
West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Sean Welleck,
Xiang Ren, Allyson Ettinger, Zaid Harchaoui, and Yejin Choi. Faith and Fate: Limits of Trans-
formers on Compositionality, June 2023. URL http://arxiv.org/abs/2305.18654.
arXiv:2305.18654 [cs].

Guhao Feng, Bohang Zhang, Yuntian Gu, Haotian Ye, Di He, and Liwei Wang. Towards Revealing
the Mystery behind Chain of Thought: A Theoretical Perspective, June 2023. URL http:
//arxiv.org/abs/2305.15408. arXiv:2305.15408 [cs, stat].

Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting
Hu. Reasoning with Language Model is Planning with World Model, May 2023. URL http:
//arxiv.org/abs/2305.14992. arXiv:2305.14992 [cs].
CHAIN-OF-THOUGHTREASONING IS APOLICY IMPROVEMENTOPERATOR