Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings
We present Knesset-DictaBERT, a large Hebrew language model fine-tuned on the
Knesset Corpus, which comprises Israeli parliamentary proceedings. The model is
based on the DictaBERT architecture and demonstrates significant improvements
in understanding parliamentary language according to the MLM task. We provide a
detailed evaluation of the model's performance, showing improvements in
perplexity and accuracy over the baseline DictaBERT model.
66a9c689d0a8819d66de11fe
Gili Goldin
extracted_confirmed
2024-07-31T05:08:18.441Z
63b2846b7091e602f1974c82
/avatars/e848cab2094f87b6491574f364b33fdf.svg
Gili Goldin
user
GiliGold
66a9c689d0a8819d66de11ff
Shuly Wintner
Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings
We present Knesset-DictaBERT, a large Hebrew language model fine-tuned on the
Knesset Corpus, which comprises Israeli parliamentary proceedings. The model is
based on the DictaBERT architecture and demonstrates significant improvements
in understanding parliamentary language according to the MLM task. We provide a
detailed evaluation of the model's performance, showing improvements in
perplexity and accuracy over the baseline DictaBERT model.
Knesset-DictaBERT, a Hebrew language model fine-tuned on Israeli parliamentary data, shows enhanced performance in understanding parliamentary language compared to the original DictaBERT.
Knesset-DictaBERT DictaBERT Parliamentary language MLM task Perplexity Accuracy