CodeXGlue benchmark (Lu et al., 2021). Here we focused on the main problem of program synthesis, as
well as infilling/completion for our 7B and 13B models where the ability comes with little impact on the
generation performance as previously observed by Bavarian et al. (2022).
CodeLlama2