readme: ---
  language: my
  tags:
  - MyanBERTa
  - Myanmar
  - BERT
  - RoBERTa
  license: apache-2.0
  datasets:
  - MyCorpus
  - Web
  ---
  
  ## Model description
  
  This model is a BERT based Myanmar pre-trained language model.
  MyanBERTa was pre-trained for 528K steps on a word segmented Myanmar dataset consisting of 5,992,299 sentences (136M words).
  As the tokenizer, byte-leve BPE tokenizer of 30,522 subword units which is learned after word segmentation is applied.
  
  Cite this work as:
  
  ```
  Aye Mya Hlaing, Win Pa Pa, "MyanBERTa: A Pre-trained Language Model For
  Myanmar", In Proceedings of 2022 International Conference on Communication and Computer Research (ICCR2022), November 2022, Seoul, Republic of Korea
  ```
  
  [Download Paper](https://journal-home.s3.ap-northeast-2.amazonaws.com/site/iccr2022/abs/QOHFI-0004.pdf)
  
  
  
  