Aligning Noisy Parallel Corpora Across Language Groups : Word Pair Feature Matching by Dynamic Time Warping
<|reference_start|>Aligning Noisy Parallel Corpora Across Language Groups : Word Pair Feature Matching by Dynamic Time Warping: We propose a new algorithm called DK-vec for aligning pairs of Asian/Indo-European noisy parallel texts without sentence boundaries. DK-vec improves on previous alignment algorithms in that it handles better the non-linear nature of noisy corpora. The algorithm uses frequency, position and recency information as features for pattern matching. Dynamic Time Warping is used as the matching technique between word pairs. This algorithm produces a small bilingual lexicon which provides anchor points for alignment.<|reference_end|>
@article{fung1994aligning,
    title={Aligning Noisy Parallel Corpora Across Language Groups : Word Pair
  Feature Matching by Dynamic Time Warping},
    author={Pascale Fung (Columbia University), Kathleen McKeown (Columbia
  University)},
    journal={Proc. AMTA-94},
    year={1994},
    archivePrefix={arXiv},
    eprint={cmp-lg/9409011},
    primaryClass={cmp-lg cs.CL}
}