title: Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings
summary: We present Knesset-DictaBERT, a large Hebrew language model fine-tuned on the
  Knesset Corpus, which comprises Israeli parliamentary proceedings. The model is
  based on the DictaBERT architecture and demonstrates significant improvements
  in understanding parliamentary language according to the MLM task. We provide a
  detailed evaluation of the model's performance, showing improvements in
  perplexity and accuracy over the baseline DictaBERT model.
paper_authors._id: 66a9c689d0a8819d66de11fe
paper_authors.name: Gili Goldin
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2024-07-31T05:08:18.441Z
paper_authors._id: 63b2846b7091e602f1974c82
paper_authors.avatarUrl: /avatars/e848cab2094f87b6491574f364b33fdf.svg
paper_authors.fullname: Gili Goldin
paper_authors.type: user
paper_authors.user: GiliGold
paper_authors._id: 66a9c689d0a8819d66de11ff
paper_authors.name: Shuly Wintner
paper_title: Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings
paper_summary: We present Knesset-DictaBERT, a large Hebrew language model fine-tuned on the
  Knesset Corpus, which comprises Israeli parliamentary proceedings. The model is
  based on the DictaBERT architecture and demonstrates significant improvements
  in understanding parliamentary language according to the MLM task. We provide a
  detailed evaluation of the model's performance, showing improvements in
  perplexity and accuracy over the baseline DictaBERT model.
paper_ai_keywords: Knesset-DictaBERT Hebrew language model Knesset Corpus Israeli parliamentary proceedings DictaBERT architecture MLM task perplexity accuracy baseline DictaBERT model