There are two corpora normally used for evaluation in a number of text-processing tasks : the Brown corpus ( Francis and Kucera 1982 ) and the Wall Street Journal ( WSJ ) corpus , both part of the Penn Treebank ( Marcus , Marcinkiewicz , and Santorini 1993 ) .
frequency analysis of english usage lexicon and grammar
W Nelson Francis Henry Kucera
2.1 Corpora for Evaluation There are two corpora normally used for evaluation in a number of text-processing tasks : the Brown corpus ( Francis and Kucera 1982 ) and the Wall Street Journal ( WSJ ) corpus , both part of the Penn Treebank ( Marcus , Marcinkiewicz , and Santorini 1993 ) . The Brown corpus represents general English .
There are two corpora normally used for evaluation in a number of text-processing tasks : the Brown corpus ( @@CITATION ) and the Wall Street Journal ( WSJ ) corpus , both part of the Penn Treebank ( Marcus , Marcinkiewicz , and Santorini 1993 ) .