do not read Terms of Service, and additionally that
being ToS-compliant does not entail authorial con-
sent. We adopted a strict model of consent, where
ambiguous or unknown consent is treated as non-
consensual.
The Pile- An 800GB Dataset of Diverse Text for Language Modeling