Ilya Loshchilov and Frank Hutter. 2019. Decoupled
weight decay regularization. In International Confer-
ence on Learning Representations.

Ziyang Luo, Can Xu, Pu Zhao, Qingfeng Sun, Xi-
ubo Geng, Wenxiang Hu, Chongyang Tao, Jing Ma,
Qingwei Lin, and Daxin Jiang. 2023. Wizardcoder:
Empowering code large language models with evol-
instruct.

Erik Nijkamp, Bo Pang, Hiroaki Hayashi, Lifu Tu, Huan
Wang, Yingbo Zhou, Silvio Savarese, and Caiming
Xiong. 2023. Codegen: An open large language
model for code with multi-turn program synthesis.

Changan Niu, Chuanyi Li, Vincent Ng, Dongxiao Chen,
Jidong Ge, and Bin Luo. 2023. An empirical com-
parison of pre-trained models of source code.
In
2023 IEEE/ACM 45th International Conference on
Software Engineering (ICSE), pages 2136–2148.

OpenAI. 2023. Chat-gpt. Last-accesed: Oct 2023.

Yotam Perlitz, Liat Ein-Dor, Dafna Sheinwald, Noam
Slonim, and Michal Shmueli-Scheuer. 2023. Diver-
sity enhanced table-to-text generation via type con-
trol.
CODEFUSION