Various feature selection techniques have been used in automatic text categorization ; they include document frequency ( DF ) , information gain ( IG ) ( Tzeras and Hartman , 1993 ) , minimum description length principal ( Lang , 1995 ) , and the X2 statistic .
automatic indexing based on bayesian inference networksquot
K Tzeras S Hartman
Feature selection techniques have been widely used in information retrieval as a means for coping with the large number of words in a document ; a selection is made to keep only the more relevant words . Various feature selection techniques have been used in automatic text categorization ; they include document frequency ( DF ) , information gain ( IG ) ( Tzeras and Hartman , 1993 ) , minimum description length principal ( Lang , 1995 ) , and the X2 statistic . ( Yang and Pedersen , 1997 ) has found strong correlations between DF , IG and the X2 statistic for a term .
Various feature selection techniques have been used in automatic text categorization ; they include document frequency ( DF ) , information gain ( IG ) ( @@CITATION ) , minimum description length principal ( Lang , 1995 ) , and the X2 statistic .