 BERT BASE (cased) finetuned on Bulgarian natural-language-inference data  Pretrained model on Bulgarian language using a masked language modeling (MLM) objective. It was introduced in [this paper](https://arxiv.org/abs/1810.04805) and first released in [this repository](https://github.com/google-research/bert). This model is cased: it does make a difference between bulgarian and Bulgarian. The training data is Bulgarian text from [OSCAR](https://oscar-corpus.com/post/oscar-2019/), [Chitanka](https://chitanka.info/) and [Wikipedia](https://bg.wikipedia.org/).  It was finetuned on private NLI Bulgarian data.  Then, it was compressed via [progressive module replacing](https://arxiv.org/abs/2002.02925).  