readme: ---
  language: ru
  license: apache-2.0
  ---
  
  RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.
  
  Read more about the model in [this blog post](https://habr.com/ru/company/yandex/blog/688234/) (in Russian).
  
  See its implementation, as well as the pretraining and finetuning code, at [https://github.com/yandex-research/RuLeanALBERT](https://github.com/yandex-research/RuLeanALBERT).