1

I N T R O D U C T I O N

Large Language Models (LLMs; Brown et al., 2020; Chen et al., 2021; Chowdhery et al., 2022; Zhang
et al., 2022; OpenAI, 2023a), such as OpenAI’s ChatGPT, are taking the world by storm. Within a

1
StarCoder_paper (1)