HMM Specialization with Selective Lexicalization
<|reference_start|>HMM Specialization with Selective Lexicalization: We present a technique which complements Hidden Markov Models by incorporating some lexicalized states representing syntactically uncommon words. Our approach examines the distribution of transitions, selects the uncommon words, and makes lexicalized states for the words. We performed a part-of-speech tagging experiment on the Brown corpus to evaluate the resultant language model and discovered that this technique improved the tagging accuracy by 0.21% at the 95% level of confidence.<|reference_end|>
@article{kim1999hmm,
    title={HMM Specialization with Selective Lexicalization},
    author={Jin-Dong Kim and Sang-Zoo Lee and Hae-Chang Rim},
    journal={Proceedings of the 1999 Joint SIGDAT Conference on Empirical
  Methods in Natural Language Processing and Very Large Corpora, pp.121-127,
  1999},
    year={1999},
    archivePrefix={arXiv},
    eprint={cs/9912016},
    primaryClass={cs.CL cs.LG}
}