Text Segmentation Based on Similarity between Words
<|reference_start|>Text Segmentation Based on Similarity between Words: This paper proposes a new indicator of text structure, called the lexical cohesion profile (LCP), which locates segment boundaries in a text. A text segment is a coherent scene; the words in a segment are linked together via lexical cohesion relations. LCP records mutual similarity of words in a sequence of text. The similarity of words, which represents their cohesiveness, is computed using a semantic network. Comparison with the text segments marked by a number of subjects shows that LCP closely correlates with the human judgments. LCP may provide valuable information for resolving anaphora and ellipsis.<|reference_end|>
@article{kozima1996text,
    title={Text Segmentation Based on Similarity between Words},
    author={Hideki Kozima (University of Electro-Communications, Japan)},
    journal={Proceedings of ACL-93 (Ohio), pp.286-288, 1993.},
    year={1996},
    archivePrefix={arXiv},
    eprint={cmp-lg/9601005},
    primaryClass={cmp-lg cs.CL}
}