&gt; Reducing the sparsity brought that down to about 3,100 unique words [from 30,600 unique words]<p>What does that mean? Does he remove words that are only said once or twice?<p>Can anyone point me to a text explaining the difference between Identifying Characteristic Words using <i>Log Likelihood </i>and using <i>tfidf</i>. ?