readme: ---
  language:
  - ru
  tags:
  - fluency
  ---
  
  This is a [ruRoberta-large](https://huggingface.co/sberbank-ai/ruRoberta-large) model trained on the [RuCoLa](https://rucola-benchmark.com/) dataset. It can be used to classify Russian sentences into fluent or non-fluent ones, where fluency is understood as linguistic acceptability. 
  
  Training notebook: `task_oriented_TST/fluency/rucola_classifier_v1.ipynb` (in a private repo). 
  
  Training parameters: 
  * optimizer: Adam
  * `lr=2e-6`
  * `batch_size=32`
  * `epochs=10`
  * `clip_grad_norm=1.0`
  
  Test accuracy (on the [leaderboard](https://rucola-benchmark.com/leaderboard) this model is submitted as `ruroberta-base-cased-rucola-v1`): 0.81.