Topic #5
new
dating
art
day
city
data
study
patients
cells
c
said
like
time
new
way
said
government
year
market
business
phys
data
energy
ﬁeld
b
const
typename
return
void
template
court
trial
evidence
defendant
united
device
spring
android
app
boot
data
system
memory
information
devices
retinal
eye
lens
corneal
laser
said
great
like
man
little
know
right
like
oh
want
ﬁlm
category
ﬁlms
new
television
let
common
calculate
suppose
highest
ubuntu
like
think
yeah
know
said
like
time
know
going
european
mr
commission
president
parliament
people
like
time
think
use
like
think
people
know
going
theory
science
physical
de
case
cells
speciﬁc
cell
study
aim
subject
enron
said
sent
image

Table 16: Topic Terms
The Pile- An 800GB Dataset of Diverse Text for Language Modeling