measure of blatant toxicity. We report our results in Table 25.
In general, we observe that CodeGen-16B-Multi and StarCoderBase both appear to generate less toxic
responses than LLaMA-13B. For instance, 1.43% of LLaMA-13B’s responses contain potentially
offensive tokens compared to the 1.12% of StarCoderBase. We also note that CodeGen-16B-Multi
appears to generate less toxic responses than StarCoderBase.
StarCoder_paper (1)