1e− 4, β1 = 0.9, and β2 = 0.999. Our non-neural baseline media diet models were 3-gram models with Kneser-Ney smoothing
trained on the respective media diet datasets.
∑w(cid:48)∈w(cid:83)synonyms(w) MediaDietBERT (prompt,w(cid:48))
Synonyms were obtained through the Oxford Languages dictionary and manually checked to match the word sense and ﬁt
gramamatically. To do the normalization for our N-gram media diet models, scores s are divided by the probability of w under
the Google Web Trillion Word Corpus.
Language models trained on media diets can predict public opinion