Topic #13
Geography
Cells
Unknown
Military
Physics
Java
Legal
HTML/CSS
Data
Clinical

Unknown
Unknown
Geography
Simpliﬁcation
Software
Unknown
International
Politics
Software
Unknown
Epistemology
Disease
Email

Topic #14
Sports
Cells
Unknown
Unknown
Physics
C/C++
Legal
Java
Imaging
Medical Imag-
ing
Unknown
Unknown
Sports
Calculation
Pull Requests
Unknown
International
Politics
Generic
Unknown
Science
Disease
Email

Topic $15
Medicine
Cells
Unknown
Research
Math
Unknown
Legal
SQL
Imaging
Cells

Unknown
Unknown
History
Units
Software
Unknown
International
Politics
Generic
Unknown
Logic
Disease
Computer

Table 14: Topic Summaries

Topic #8
Entertainment
Cells
Unknown
Generic
Dynamics
Unknown
Appeals
Users
Data
Fluids

Unknowne
Unknown
Science

Calculation
Pull Requests
Unknown
International
Politics
Generic
Unknowne
Science
Clinical
Business

Topic #16
Generic
Cells
Unknown
Sports
Modeling
HTML/CSS
Appeals
Java
Chemistry
Cells
The Pile- An 800GB Dataset of Diverse Text for Language Modeling