Code attribution tools The StarCoder membership-checking tool and BM25 search index are
limited to dataset inspection against the subset of The Stack that was used for training and, as such,
will not find matches to code that was not included or that was removed from the dataset for this
project. The Portraits-based membership testing tool uses hash matching and thus may have false
positives. It also has a minimum resolution and requires a certain amount of context to trigger a
match. Both attribution tools do not attempt to distinguish between generic code (e.g., boilerplate) or
protected content. However, we hope that these tools will support ongoing research on the responsible
development of LLMs.
StarCoder_paper (1)