Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers
<|reference_start|>Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers: Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers, even in the absence of human experts. We explore both post-hoc and intrinsic approaches to interpretability, conduct experiments on Mandarin, Italian, and Low Saxon, and experimentally demonstrate that our method successfully identifies key language-specific lexical features that contribute to dialectal variations.<|reference_end|>
@article{xie2024extracting,
    title={Extracting Lexical Features from Dialects via Interpretable Dialect
  Classifiers},
    author={Roy Xie, Orevaoghene Ahia, Yulia Tsvetkov, Antonios Anastasopoulos},
    journal={arXiv preprint arXiv:2402.17914},
    year={2024},
    archivePrefix={arXiv},
    eprint={2402.17914},
    primaryClass={cs.CL cs.AI}
}