The Shape of Word Embeddings: Recognizing Language Phylogenies through Topological Data Analysis
<|reference_start|>The Shape of Word Embeddings: Recognizing Language Phylogenies through Topological Data Analysis: Word embeddings represent language vocabularies as clouds of $d$-dimensional points. We investigate how information is conveyed by the general shape of these clouds, outside of representing the semantic meaning of each token. Specifically, we use the notion of persistent homology from topological data analysis (TDA) to measure the distances between language pairs from the shape of their unlabeled embeddings. We use these distance matrices to construct language phylogenetic trees over 81 Indo-European languages. Careful evaluation shows that our reconstructed trees exhibit strong similarities to the reference tree.<|reference_end|>
@article{draganov2024the,
    title={The Shape of Word Embeddings: Quantifying Non-Isometry With Topological
  Data Analysis},
    author={Ondv{r}ej Draganov and Steven Skiena},
    journal={Findings of the Association for Computational Linguistics: EMNLP
  2024, pages 12080--12099. ACL},
    year={2024},
    archivePrefix={arXiv},
    eprint={2404.00500},
    primaryClass={cs.CL math.AT}
}