Prompt:
You are an expert Python programmer, and here is your task: {task}
Your code should pass these tests:\n\n{tests}\nYour code should start with a [PYTHON] tag and end with a [/PYTHON] tag.

Figure 12: Prompt for the MBPP zero-shot task. We use this prompt to evaluate our instruct models.

33
CodeLlama2