Model output:

username_1: Hi,

This is not an issue with transformers. You should look at your

GPU usage and see if you can free up some space before
training starts (or use smaller batch sizes).

Table 27: Sample uses of pretraining templates.

9 . 2

S E A R C H I N D E X

We index the training dataset using Elasticsearch 7.1722 and provide two search tools to query it: one
focused on the Python subset23 and one covering the entire dataset.24 The code itself is preprocessed

22https://www.elastic.co/guide/en/elasticsearch/reference/7.17
23https://hf.co/spaces/bigcode/py-search
24https://hf.co/spaces/bigcode/search

30

Instruction
I need to integrate a Python
function numerically, what’s
the best way to do it?
StarCoder_paper (1)