Distributional Clustering of English Words
<|reference_start|>Distributional Clustering of English Words: We describe and experimentally evaluate a method for automatically clustering words according to their distribution in particular syntactic contexts. Deterministic annealing is used to find lowest distortion sets of clusters. As the annealing parameter increases, existing clusters become unstable and subdivide, yielding a hierarchical ``soft'' clustering of the data. Clusters are used as the basis for class models of word coocurrence, and the models evaluated with respect to held-out test data.<|reference_end|>
@article{pereira1994distributional,
    title={Distributional Clustering of English Words},
    author={Fernando Pereira (AT&T Bell Laboratories), Naftali Tishby (Hebrew
  University), Lillian Lee (Harvard University)},
    journal={arXiv preprint arXiv:cmp-lg/9408011},
    year={1994},
    archivePrefix={arXiv},
    eprint={cmp-lg/9408011},
    primaryClass={cmp-lg cs.CL}
}