A Stochastic Finite-State Word-Segmentation Algorithm for Chinese
<|reference_start|>A Stochastic Finite-State Word-Segmentation Algorithm for Chinese: We present a stochastic finite-state model for segmenting Chinese text into dictionary entries and productively derived words, and providing pronunciations for these words; the method incorporates a class-based model in its treatment of personal names. We also evaluate the system's performance, taking into account the fact that people often do not agree on a single segmentation.<|reference_end|>
@article{sproat1994a,
    title={A Stochastic Finite-State Word-Segmentation Algorithm for Chinese},
    author={Richard Sproat (AT&T Bell Laboratories), Chilin Shih (AT&T Bell
  Laboratories), William Gale (AT&T Bell Laboratories), and Nancy Chang
  (Harvard University)},
    journal={in Proceedings of ACL 94},
    year={1994},
    archivePrefix={arXiv},
    eprint={cmp-lg/9405008},
    primaryClass={cmp-lg cs.CL}
}