Church and Hanks ( 1990 ) use mutual information to identify collocations , a method they claim is reasonably effective for words with a frequency of not less than five .
word association norms mutual information and lexicography
Kenneth W Church Patrick Hanks
In Smadja 's collocation algorithm Xtract , the lowest-frequency words are effectively discarded as well ( Smadja 1993 ) . Church and Hanks ( 1990 ) use mutual information to identify collocations , a method they claim is reasonably effective for words with a frequency of not less than five . A frequency threshold of five seems quite low .
@@CITATION use mutual information to identify collocations , a method they claim is reasonably effective for words with a frequency of not less than five .