Word Sense Disambiguation by Web Mining for Word Co-occurrence Probabilities
<|reference_start|>Word Sense Disambiguation by Web Mining for Word Co-occurrence Probabilities: This paper describes the National Research Council (NRC) Word Sense Disambiguation (WSD) system, as applied to the English Lexical Sample (ELS) task in Senseval-3. The NRC system approaches WSD as a classical supervised machine learning problem, using familiar tools such as the Weka machine learning software and Brill's rule-based part-of-speech tagger. Head words are represented as feature vectors with several hundred features. Approximately half of the features are syntactic and the other half are semantic. The main novelty in the system is the method for generating the semantic features, based on word \hbox{co-occurrence} probabilities. The probabilities are estimated using the Waterloo MultiText System with a corpus of about one terabyte of unlabeled text, collected by a web crawler.<|reference_end|>
@article{turney2004word,
    title={Word Sense Disambiguation by Web Mining for Word Co-occurrence
  Probabilities},
    author={Peter D. Turney (National Research Council of Canada)},
    journal={Proceedings of the Third International Workshop on the Evaluation
  of Systems for the Semantic Analysis of Text (SENSEVAL-3), (2004), Barcelona,
  Spain, 239-242},
    year={2004},
    archivePrefix={arXiv},
    eprint={cs/0407065},
    primaryClass={cs.CL cs.IR cs.LG}
}