readme: ---
  language: ca
  ---
  
  ## Introduction
  
  
  Download the model here:
  
  * Catalan Roberta model: [julibert-2020-11-10.zip](https://www.softcatala.org/pub/softcatala/julibert/julibert-2020-11-10.zip)
  
  ## What's this?
  
  Source code: https://github.com/Softcatala/julibert
  
  * Corpus: Oscar Catalan Corpus (3,8G)
  * Model type: Roberta
  * Vocabulary size: 50265
  * Steps: 500000
  
  
  
  
  