Structural Tags, Annealing and Automatic Word Classification
<|reference_start|>Structural Tags, Annealing and Automatic Word Classification: This paper describes an automatic word classification system which uses a locally optimal annealing algorithm and average class mutual information. A new word-class representation, the structural tag is introduced and its advantages for use in statistical language modelling are presented. A summary of some results with the one million word LOB corpus is given; the algorithm is also shown to discover the vowel-consonant distinction and displays an ability to cluster words syntactically in a Latin corpus. Finally, a comparison is made between the current classification system and several leading alternative systems, which shows that the current system performs respectably well.<|reference_end|>
@article{mcmahon1994structural,
    title={Structural Tags, Annealing and Automatic Word Classification},
    author={John McMahon and F.J.Smith (Queen's University, Belfast)},
    journal={arXiv preprint arXiv:cmp-lg/9405029},
    year={1994},
    archivePrefix={arXiv},
    eprint={cmp-lg/9405029},
    primaryClass={cmp-lg cs.CL}
}