MenakBERT -- Hebrew Diacriticizer
<|reference_start|>MenakBERT -- Hebrew Diacriticizer: Diacritical marks in the Hebrew language give words their vocalized form. The task of adding diacritical marks to plain Hebrew text is still dominated by a system that relies heavily on human-curated resources. Recent models trained on diacritized Hebrew texts still present a gap in performance. We use a recently developed char-based PLM to narrowly bridge this gap. Presenting MenakBERT, a character level transformer pretrained on Hebrew text and fine-tuned to produce diacritical marks for Hebrew sentences. We continue to show how finetuning a model for diacritizing transfers to a task such as part of speech tagging.<|reference_end|>
@article{cohen2024menakbert,
    title={MenakBERT -- Hebrew Diacriticizer},
    author={Ido Cohen, Jacob Gidron, Idan Pinto},
    journal={arXiv preprint arXiv:2410.02417},
    year={2024},
    archivePrefix={arXiv},
    eprint={2410.02417},
    primaryClass={cs.CL cs.LG}
}