Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings
<|reference_start|>Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings: We present Knesset-DictaBERT, a large Hebrew language model fine-tuned on the Knesset Corpus, which comprises Israeli parliamentary proceedings. The model is based on the DictaBERT architecture and demonstrates significant improvements in understanding parliamentary language according to the MLM task. We provide a detailed evaluation of the model's performance, showing improvements in perplexity and accuracy over the baseline DictaBERT model.<|reference_end|>
@article{goldin2024knesset-dictabert:,
    title={Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings},
    author={Gili Goldin (1), Shuly Wintner (1) ((1) Department of Computer
  Science, University of Haifa, Israel)},
    journal={arXiv preprint arXiv:2407.20581},
    year={2024},
    archivePrefix={arXiv},
    eprint={2407.20581},
    primaryClass={cs.CL}
}