1. StarCoder outperforms the largest models, including PaLM, LaMDA, and LLaMA, despite

being significantly smaller.

2. StarCoderBase is also very capable on Python and is only outperformed by the two models

that are fine-tuned on Python: CodeGen-16B-Mono and StarCoder itself.

3. StarCoder outperforms OpenAI’s code-cushman-001 (12B) model.
4. StarCoder achieves a state-of-the-art 40% pass@1 on HumanEval with a simple prompt

that addresses incomplete results, as described below.
StarCoder_paper (1)