readme: ---
  language: gn
  license: mit
  datasets:
  - wikipedia
  - wiktionary
  widget:
  - text: "Paraguay ha'e peteĩ táva oĩva [MASK] retãme  "
  - text: "Augusto Roa Bastos ha'e peteĩ [MASK] arandu"
  ---
  
  # BERT-i-small-cased (gnBERT-small-cased)
  
  A pre-trained BERT model for **Guarani** (6 layers, cased). Trained on Wikipedia + Wiktionary (~800K tokens).
  