 Romanian DistilBERT  This repository contains the a Romanian cased version of DistilBERT (named DistilMulti-BERT-base-ro in the paper) that was obtained by distilling an ensemble of two teacher models: [dumitrescustefan/bert-base-romanian-cased-v1](https://huggingface.co/dumitrescustefan/bert-base-romanian-cased-v1) and [readerbench/RoBERT-base](https://huggingface.co/readerbench/RoBERT-base).   The model was introduced in [this paper](https://arxiv.org/abs/2112.12650). The adjacent code can be found [here](https://github.com/racai-ai/Romanian-DistilBERT).  