Black, S., Biderman, S., Hallahan, E., Anthony, Q., Gao,
L., Golding, L., He, H., Leahy, C., McDonell, K., Phang,
J., et al. GPT-NeoX-20B: An open-source autoregressive
language model. In Proceedings of BigScience Episode
#5–Workshop on Challenges & Perspectives in Creating
Large Language Models, pp. 95–136, 2022.

Blodgett, S. L., Lopez, G., Olteanu, A., Sim, R., and
Wallach, H. Stereotyping Norwegian salmon: An in-
ventory of pitfalls in fairness benchmark datasets.
In
Proceedings of the 59th Annual Meeting of the Associa-
tion for Computational Linguistics and the 11th Interna-
tional Joint Conference on Natural Language Process-
ing (Volume 1: Long Papers), pp. 1004–1015, Online,
August 2021. Association for Computational Linguis-
tics. doi: 10.18653/v1/2021.acl-long.81. URL https:
//aclanthology.org/2021.acl-long.81.
Pythia- A Suite for Analyzing Large Language Models Across Training and Scaling