readme: ---
  language: 
  - hr
  - sl
  - en
  - multilingual
  
  license: cc-by-4.0
  ---
  # CroSloEngual BERT
  CroSloEngual BERT is a trilingual model, using bert-base architecture, trained on Croatian, Slovenian, and English corpora. Focusing on three languages, the model performs better than [multilingual BERT](https://huggingface.co/bert-base-multilingual-cased), while still offering an option for cross-lingual knowledge transfer, which a monolingual model wouldn't. 
  
  Evaluation is presented in our article:
  ```
  @Inproceedings{ulcar-robnik2020finest,
  author = "Ulčar, M. and Robnik-Šikonja, M.",
  year = 2020,
  title = "{FinEst BERT} and {CroSloEngual BERT}: less is more in multilingual models",
  editor = "Sojka, P and Kopeček, I and Pala, K and Horák, A",
  booktitle = "Text, Speech, and Dialogue {TSD 2020}",
  series = "Lecture Notes in Computer Science",
  volume = 12284,
  publisher = "Springer",
  url = "https://doi.org/10.1007/978-3-030-58323-1_11",
  }
  ```
  The preprint is available at [arxiv.org/abs/2006.07890](https://arxiv.org/abs/2006.07890).